-- Logs begin at Wed 2022-05-25 09:37:59 UTC, end at Wed 2022-05-25 10:38:14 UTC. -- May 25 10:10:04.734551 dv-osbrick-830800-14-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 25 10:10:04.744048 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 10:10:04 2022] *** May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: nodename: dv-osbrick-830800-14-ceph May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: machine: x86_64 May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: clock source: unix May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: pcre jit disabled May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: detected number of CPU cores: 4 May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: current working directory: / May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: detected binary path: /usr/bin/uwsgi-core May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: your processes number limit is 47680 May 25 10:10:04.746681 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: your memory page size is 4096 bytes May 25 10:10:04.747346 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: detected max file descriptor number: 2048 May 25 10:10:04.747346 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: lock engine: pthread robust mutexes May 25 10:10:04.747346 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: thunder lock: enabled May 25 10:10:04.747346 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 10:10:04.747346 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 10:10:04.795359 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: Python main interpreter initialized at 0x55c5b3ef79c0 May 25 10:10:04.795359 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: python threads support enabled May 25 10:10:04.795359 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: your server socket listen backlog is limited to 100 connections May 25 10:10:04.795359 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: your mercy for graceful operations on workers is 90 seconds May 25 10:10:04.795710 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: mapped 403077 bytes (393 KB) for 2 cores May 25 10:10:04.795778 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: *** Operational MODE: preforking *** May 25 10:10:04.796055 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: *** uWSGI is running in multiple interpreter mode *** May 25 10:10:04.796055 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: spawned uWSGI master process (pid: 87008) May 25 10:10:04.796279 dv-osbrick-830800-14-ceph systemd[1]: Started Devstack devstack@keystone.service. May 25 10:10:04.796948 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: spawned uWSGI worker 1 (pid: 87019, cores: 1) May 25 10:10:04.797303 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: spawned uWSGI worker 2 (pid: 87020, cores: 1) May 25 10:10:04.797461 dv-osbrick-830800-14-ceph devstack@keystone.service[87008]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 10:10:10.491916 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 10:10:10.491916 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: from cryptography.utils import int_from_bytes May 25 10:10:10.492742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 10:10:10.492742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: from cryptography.utils import int_from_bytes May 25 10:10:10.493146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 10:10:10.493146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: from cryptography.utils import int_from_bytes May 25 10:10:10.493253 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 10:10:10.493253 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: from cryptography.utils import int_from_bytes May 25 10:10:10.540927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 10:10:10.541118 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 10:10:10.541118 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 10:10:10.541266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 10:10:10.541266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] command line args: [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 10:10:10.541381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] command line args: [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 10:10:10.541518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 10:10:10.541598 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 10:10:10.541665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ================================================================================ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 10:10:10.541723 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ================================================================================ {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 10:10:10.541938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] admin_token = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] admin_token = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] config_dir = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] config_dir = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542318 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542397 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542477 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] config_source = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] config_source = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] debug = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542744 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] debug = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.542877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543240 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543347 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543410 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543639 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543872 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.543961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544094 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] list_limit = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544245 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] log_config_append = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] log_config_append = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] log_dir = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] log_dir = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] log_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.544809 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] log_file = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.545004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.545129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.545196 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.545266 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.545445 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.545528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.545766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546304 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546304 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546451 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546888 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.546944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547595 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.547851 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.548068 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.548194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.548330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.548412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.548848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.549072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.549237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] publish_errors = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.549372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] publish_errors = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.549546 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.549707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.549855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.550033 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.550174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.550322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.550453 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.550667 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.550784 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.550923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] standard_threads = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551183 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] standard_threads = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551334 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551451 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551601 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551723 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551838 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.551959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] use_journal = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] use_journal = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552315 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] use_json = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552435 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] use_json = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552549 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] use_stderr = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] use_stderr = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552785 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] use_syslog = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.552904 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] use_syslog = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.553047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.553162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 10:10:10.553275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.553403 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.553518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.553631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.553744 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.553859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.553986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554228 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554341 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554568 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554763 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.554992 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.555098 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.555211 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.555349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.555514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.555656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.555777 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.555889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556120 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556245 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556366 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556481 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556825 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.556951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.557957 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558070 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558189 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558314 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558426 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558546 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558782 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.558901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559258 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559873 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.559986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.560098 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.560211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.560329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.560535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.560651 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.560799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.560946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.561062 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.561182 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.561305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.561876 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562006 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562130 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562245 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562595 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562823 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.562942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563451 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563808 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.563808 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.564025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.564138 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.564252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.564364 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.564830 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.564949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565289 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565522 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565864 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.565977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566474 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566597 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566712 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566826 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.566947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567062 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567554 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567678 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.567906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568141 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568256 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568618 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568740 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568864 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.568986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.569168 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.569294 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.569410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.569524 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.569650 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.569766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.569893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570137 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570251 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570478 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570598 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570719 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.570961 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571074 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571189 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571559 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.571911 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572307 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572422 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572650 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572763 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.572877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573065 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573182 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573417 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573532 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573658 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573658 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573881 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.573881 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574095 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574343 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574458 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574783 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.574903 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575029 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575258 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575544 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575658 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575784 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.575909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576491 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.576842 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.577124 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.577656 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.577792 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.577919 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578167 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578873 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.578987 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579101 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579354 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.external = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579835 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.579958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580197 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] auth.external = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.password = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580481 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580608 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] auth.token = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.580953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581067 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] auth.password = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] auth.token = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581882 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.581996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582339 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582577 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582692 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582806 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.582921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583319 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583436 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] credential.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.583908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584375 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584777 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.584897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585019 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585248 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585609 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585954 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.585954 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586521 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.586991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.587105 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.587221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.587350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.587548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.587674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.587791 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.587914 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.588963 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589194 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589423 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589537 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589780 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.589894 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590238 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590366 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590710 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590824 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.590939 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591062 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591339 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591339 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591556 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591822 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.591944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.592059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.592174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.592288 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.592410 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.592560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.592736 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.593246 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.593372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.593497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.593497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.593725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.593725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.593940 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594169 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594409 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594640 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594754 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594868 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.594992 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595108 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595600 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595723 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.595953 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596296 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596656 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596772 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.596887 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597125 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597477 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597815 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.597930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598054 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598170 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598398 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598522 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.598981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599095 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599817 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.599944 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600060 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600174 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600288 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600646 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.600991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601105 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601458 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601573 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.601914 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602037 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602267 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602380 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602495 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602609 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.602970 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603083 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603197 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603825 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.603938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604356 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604471 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604592 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604709 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604832 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.604949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605277 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605277 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605716 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.605945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606167 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606512 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606627 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606740 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.606980 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607094 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607209 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607337 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607453 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607580 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607697 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.607926 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.608040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.608202 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.608527 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.608920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609158 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609388 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609513 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609744 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609858 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.609974 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610088 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610445 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610560 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.610982 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611101 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611217 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611383 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611628 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611869 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.611983 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612099 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612328 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612451 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612796 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] role.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.612911 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] role.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613149 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613265 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613386 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613501 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613615 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613730 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613854 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.613969 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614199 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614314 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614428 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614782 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] role.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.614897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615012 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] role.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615250 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615385 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615615 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615730 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615844 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.615973 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616089 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616435 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616435 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.616889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617771 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.617894 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618238 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618354 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618471 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618595 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618711 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.618825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619531 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619646 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619761 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.619875 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620002 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620697 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620817 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.620931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621045 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621511 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621739 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621853 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.621975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622090 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622564 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.622916 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.623030 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.623144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.623258 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.623441 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.623559 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.623674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.624045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.624312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.624508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.624640 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.624758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625149 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625265 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625380 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625505 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625621 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625737 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625861 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.625986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626103 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626217 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626572 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.626917 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627154 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627289 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627749 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.627994 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.connection = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628359 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628715 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.628832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629048 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629398 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629515 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.629971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87019) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.630282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.631209 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 10:10:10.631209 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 10:10:10.654438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.654658 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.654880 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.656319 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.656557 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.656781 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.663725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.665498 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.692086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.692283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.693801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.694035 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.744103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.745017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.794089 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.794277 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.795039 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.795296 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.860289 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.860465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.860563 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.860716 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.860856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.860934 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.861011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.861090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.861168 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.861323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.861450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.861619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886083 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886341 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886418 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886493 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886652 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886793 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886874 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.886950 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.887047 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.887126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.887324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.887590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.887687 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.898612 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.899134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.911418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.911634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.911881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912007 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912233 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912458 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87019) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.912890 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.913046 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.913282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 10:10:10.930025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.930241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 10:10:10.930538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.930663 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.930741 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 10:10:10.930804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 10:10:10.930971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.931065 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.931243 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.931390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 10:10:10.931553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.931678 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.931865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.932013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.932250 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.932515 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.943051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.943320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.943606 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.943877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.944003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.944143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.944405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.944687 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.951948 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.952833 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.955405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.955677 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.955950 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.956223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.956350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.956489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.956578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.956688 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.956770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.956974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957102 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957627 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957713 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.957998 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.958128 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.958332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.958615 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.958885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.984160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.985359 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.985734 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.986641 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.987095 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.987487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.991246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.991610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.991909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.992922 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.993314 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.993594 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:10.999545 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:10.999765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.001456 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.001744 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.004467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.004749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.005024 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.005297 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.005554 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.005823 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.006084 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.006210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.006344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.006496 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.006779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.007066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.007372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.007655 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.007928 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.008201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.025048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.025317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.028833 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.029121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.029832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.033731 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.033857 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.033999 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.037457 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.037753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.038955 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.042661 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.042787 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.046350 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.046644 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.046769 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.046909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.047188 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.047476 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.047776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.050321 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.050617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.050909 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.051201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.051510 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.051791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.067045 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.067308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.067599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.067855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.071349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.071661 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.071936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.072203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.076023 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.077793 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.078061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.080549 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.081100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.081381 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.081660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.081935 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.082249 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.082376 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.082576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.085612 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.085903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.086198 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.086481 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.086879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.095503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.095774 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.096052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.096324 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.096598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.096881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.097147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.100253 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.100531 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.100814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.101109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.101364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.101657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.101933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.114963 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.118192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.120122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.121518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.123187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.123414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.124952 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.126412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.126701 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.126839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.128382 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.130249 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.131748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.132044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.133940 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.135543 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.138736 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.139002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.139323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.139476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.139728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.141015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.144262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.144554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.144844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.145132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.148908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.149185 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.149462 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.154333 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.154620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.154902 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.157498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87019) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.157782 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.158057 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.158323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.158554 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.158844 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.159115 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.159406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.159654 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.159952 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.160298 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.160554 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.160826 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.161080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87019) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.162774 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 10:10:11.163056 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.163364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.163645 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.163917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.164186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.164459 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.164752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.165037 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.165303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.165675 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.165945 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.166211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.166491 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 10:10:11.199416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c5b3ef79c0 pid: 87019 (default app) May 25 10:10:11.202969 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4f29-b7bf-4d8c-a94b-9b361ee5bc74 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:11.203255 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4f29-b7bf-4d8c-a94b-9b361ee5bc74 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:11.203551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4f29-b7bf-4d8c-a94b-9b361ee5bc74 None None] PATH_INFO: `/v3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:11.206051 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c5b3ef79c0 pid: 87020 (default app) May 25 10:10:11.207832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Wed May 25 10:10:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:19.369351 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bddb-1fc2-4c44-94ca-db5963f4b7c5 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:19.370275 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bddb-1fc2-4c44-94ca-db5963f4b7c5 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:19.370275 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bddb-1fc2-4c44-94ca-db5963f4b7c5 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:19.378353 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:19 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:19.387103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:19.387566 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:19.387756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:19.460493 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: INFO dbcounter [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] Registered counter for database keystone May 25 10:10:19.486454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87019) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 10:10:19.496378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writer thread running {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 10:10:19.791788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG passlib.handlers.bcrypt [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87019) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 10:10:19.792233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG passlib.handlers.bcrypt [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87019) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 10:10:19.849813 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:19.851475 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:19.983545 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 10:10:20.186584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bddb-1fc2-4c44-94ca-db5963f4b7c5 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:20.264355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: INFO dbcounter [None req-ab91bddb-1fc2-4c44-94ca-db5963f4b7c5 None None] Registered counter for database keystone May 25 10:10:20.286376 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG oslo_db.sqlalchemy.engines [None req-ab91bddb-1fc2-4c44-94ca-db5963f4b7c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 10:10:20.296944 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writer thread running {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 10:10:20.417634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bddb-1fc2-4c44-94ca-db5963f4b7c5 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:20.426915 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51077423-bfe4-455e-ae46-9a36e5719239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:20.427974 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51077423-bfe4-455e-ae46-9a36e5719239 admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:20.428372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51077423-bfe4-455e-ae46-9a36e5719239 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:20.428760 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51077423-bfe4-455e-ae46-9a36e5719239 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:20.442297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51077423-bfe4-455e-ae46-9a36e5719239 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:20.607556 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51077423-bfe4-455e-ae46-9a36e5719239 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 10:10:20.607924 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51077423-bfe4-455e-ae46-9a36e5719239 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:20.619929 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Wed May 25 10:10:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 10:10:20.629190 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:20.653121 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ca26a-0d05-4597-9582-a179566a8baf None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:20.659685 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19413ef2-09ff-4f74-bc25-366e25b47d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:20.660838 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19413ef2-09ff-4f74-bc25-366e25b47d14 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:20.661125 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19413ef2-09ff-4f74-bc25-366e25b47d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:20.661405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19413ef2-09ff-4f74-bc25-366e25b47d14 admin admin] PATH_INFO: `/v3/projects/460d90891ba54a98b3b62dfbf4e206e2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:20.663068 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19413ef2-09ff-4f74-bc25-366e25b47d14 admin admin] RBAC: Authorizing `identity:get_project(project_id=460d90891ba54a98b3b62dfbf4e206e2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:20.715126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING keystone.common.rbac_enforcer.enforcer [None req-19413ef2-09ff-4f74-bc25-366e25b47d14 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 10:10:20.715433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19413ef2-09ff-4f74-bc25-366e25b47d14 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:20.720176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Wed May 25 10:10:20 2022] GET /identity/v3/projects/460d90891ba54a98b3b62dfbf4e206e2 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:23.017345 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb4af-0c11-441b-9ecd-75dd9f1c6aad None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:23.017909 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb4af-0c11-441b-9ecd-75dd9f1c6aad None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:23.017909 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfb4af-0c11-441b-9ecd-75dd9f1c6aad None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:23.024769 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:23.032744 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dd367-8aa7-4c54-8997-f6fafe504185 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:23.033203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dd367-8aa7-4c54-8997-f6fafe504185 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:23.033296 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dd367-8aa7-4c54-8997-f6fafe504185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:23.053905 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-487dd367-8aa7-4c54-8997-f6fafe504185 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:23.055477 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-487dd367-8aa7-4c54-8997-f6fafe504185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:23.064130 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 10:10:23.088472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfb4af-0c11-441b-9ecd-75dd9f1c6aad None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:23.102581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfb4af-0c11-441b-9ecd-75dd9f1c6aad None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:23.107850 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00b295-1767-4854-a6a6-c80a9eed6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:23.108519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b295-1767-4854-a6a6-c80a9eed6cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:23.108801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b295-1767-4854-a6a6-c80a9eed6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:23.109079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00b295-1767-4854-a6a6-c80a9eed6cf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:23.117932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00b295-1767-4854-a6a6-c80a9eed6cf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:23.119776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00b295-1767-4854-a6a6-c80a9eed6cf9 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:23.129321 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Wed May 25 10:10:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 10:10:23.136972 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dd367-8aa7-4c54-8997-f6fafe504185 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:23.148205 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dd367-8aa7-4c54-8997-f6fafe504185 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:23.155019 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f590d1a-0677-484b-98f5-4e117bfbf433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:23.155979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f590d1a-0677-484b-98f5-4e117bfbf433 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:23.156266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f590d1a-0677-484b-98f5-4e117bfbf433 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:23.156547 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f590d1a-0677-484b-98f5-4e117bfbf433 admin admin] PATH_INFO: `/v3/users/f728f0a5a3434bf7868adf527331fd5c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:23.158141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f590d1a-0677-484b-98f5-4e117bfbf433 admin admin] RBAC: Authorizing `identity:get_user(user_id=f728f0a5a3434bf7868adf527331fd5c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:23.160064 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f590d1a-0677-484b-98f5-4e117bfbf433 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:23.161694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Wed May 25 10:10:23 2022] GET /identity/v3/users/f728f0a5a3434bf7868adf527331fd5c => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:25.496177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3fc79-736e-46fd-a525-aead0271033b None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:25.496724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3fc79-736e-46fd-a525-aead0271033b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:25.496724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3fc79-736e-46fd-a525-aead0271033b None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:25.498184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:25.503771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5fa8d-3940-4575-a27a-d804e740f1d6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:25.504213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5fa8d-3940-4575-a27a-d804e740f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:25.504305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5fa8d-3940-4575-a27a-d804e740f1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:25.521499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-61a5fa8d-3940-4575-a27a-d804e740f1d6 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:25.522672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-61a5fa8d-3940-4575-a27a-d804e740f1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:25.535760 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b62dc-62c2-4648-a170-59c7972b7d78 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:25.536057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b62dc-62c2-4648-a170-59c7972b7d78 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:25.536326 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b62dc-62c2-4648-a170-59c7972b7d78 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:25.537685 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:10:25.542507 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:25.542795 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:25.543076 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:25.585720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG passlib.handlers.bcrypt [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87020) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 10:10:25.586154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG passlib.handlers.bcrypt [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87020) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 10:10:25.608110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:25.632870 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:25.633519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5fa8d-3940-4575-a27a-d804e740f1d6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:25.634475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:25.659041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:25.736971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:25.739484 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5fa8d-3940-4575-a27a-d804e740f1d6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:25.760274 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:25.776075 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:25.776900 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:25.777193 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:25.777474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:25.788773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:25.800144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:25.801203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:10:25.806983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:10:25.807688 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:25.864411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971e49-82ef-4ce0-a097-3f9433ee944c None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:25.866675 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:25.892329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:25.902348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:25.903265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:25.903579 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:25.903862 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:25.911684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff95d0-5f18-4b9f-9c03-fd160cfba3eb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:25.945260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:25.946018 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:25.946308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:25.946589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:25.947386 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:25.947732 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:25.949164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:25.961265 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:25.966920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:25.972633 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:25.974200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:26.069968 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf00f9-bdb0-4257-b333-69a5a37460b0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:26.077286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:10:26.082904 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:26.085650 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:26.104780 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:26.105676 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:26.105964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:26.106247 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] PATH_INFO: `/v3/users/f728f0a5a3434bf7868adf527331fd5c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:26.107490 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] RBAC: Authorizing `identity:get_user(user_id=f728f0a5a3434bf7868adf527331fd5c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:26.109123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:26.110778 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:25 2022] GET /identity/v3/users/f728f0a5a3434bf7868adf527331fd5c => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:26.116299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:26.130783 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:26.183225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ec78-b7d3-4f43-9aaa-5d064cd7cb00 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:26.215865 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bcb81-760c-463e-8947-b881c9ef6e3a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:26.217696 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:26.218511 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:26.218787 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:26.219057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:26.243195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:26.244728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:26.249637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:26.250452 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:26.250740 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:26.251017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:26.252245 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:26.253730 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:26.255413 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 10/18] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:26.261487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:10:26.265425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:26.266248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:26.267057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:10:26.267057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:10:26.267057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:10:26.267057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:26.267057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 9/19] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:26.273618 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:26.330042 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:26.345890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:26.366279 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46fbf-fe6f-48a0-acb0-469d34eaf7f3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:26.373096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd512bb-08a7-461f-ac3e-937f4fa3d45d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:26.400143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27186ebd-cf8e-4478-9c54-cdbadbd415af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:26.400804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186ebd-cf8e-4478-9c54-cdbadbd415af None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:26.401085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186ebd-cf8e-4478-9c54-cdbadbd415af None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:26.401366 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27186ebd-cf8e-4478-9c54-cdbadbd415af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:26.402211 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186ebd-cf8e-4478-9c54-cdbadbd415af None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.domain.id=default, user.id=f728f0a5a3434bf7868adf527331fd5c) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:26.402525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186ebd-cf8e-4478-9c54-cdbadbd415af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:26.404016 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27186ebd-cf8e-4478-9c54-cdbadbd415af None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:26.407158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24ada-c3fd-4fae-ba75-e3e3f11d1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:26.407847 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24ada-c3fd-4fae-ba75-e3e3f11d1d5d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:26.408132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24ada-c3fd-4fae-ba75-e3e3f11d1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:26.408397 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24ada-c3fd-4fae-ba75-e3e3f11d1d5d None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:26.409121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f24ada-c3fd-4fae-ba75-e3e3f11d1d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:26.409423 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f24ada-c3fd-4fae-ba75-e3e3f11d1d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:26.410857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 11/20] 10.222.0.67 () {56 vars in 1322 bytes} [Wed May 25 10:10:26 2022] GET /identity/v3/role_assignments?user.id=f728f0a5a3434bf7868adf527331fd5c&scope.domain.id=default&role.id=079434fe84194c03ae64e10d61e222e6 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:26.410955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f24ada-c3fd-4fae-ba75-e3e3f11d1d5d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:26.430776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 10/21] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:29.242273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a7f8d-656c-487e-b198-7499d303250c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.243179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a7f8d-656c-487e-b198-7499d303250c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.243619 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a7f8d-656c-487e-b198-7499d303250c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.245487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 12/22] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:29.251320 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55536e22-fded-4b13-8ca0-66b7f041c0e2 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.252171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55536e22-fded-4b13-8ca0-66b7f041c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.252591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55536e22-fded-4b13-8ca0-66b7f041c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.270939 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-55536e22-fded-4b13-8ca0-66b7f041c0e2 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:29.272389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-55536e22-fded-4b13-8ca0-66b7f041c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:29.364271 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 11/23] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:29.387779 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a7f8d-656c-487e-b198-7499d303250c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:29.519608 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a7f8d-656c-487e-b198-7499d303250c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:29.557164 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7311f-b8ed-40c7-8bcd-2d2284037050 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.557770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7311f-b8ed-40c7-8bcd-2d2284037050 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.558219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7311f-b8ed-40c7-8bcd-2d2284037050 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.560197 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 12/24] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:29.567289 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:29.568135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.568427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.568705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.576524 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b18074-ad9d-4810-a84a-bd170f491d8b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.577105 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b18074-ad9d-4810-a84a-bd170f491d8b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.577555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b18074-ad9d-4810-a84a-bd170f491d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.581115 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:29.592699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:29.593596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:10:29.594340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 13/25] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:29.606592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:29.611609 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:29.620337 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-47b18074-ad9d-4810-a84a-bd170f491d8b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:29.623489 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-47b18074-ad9d-4810-a84a-bd170f491d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:29.713549 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:29.742017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79b848-593a-42f1-81a0-1b0f3a838dbc None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:29.761898 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 13/26] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:29.763268 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0541cc-5a68-4ab5-a533-a01bd384aa25 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.763587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0541cc-5a68-4ab5-a533-a01bd384aa25 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.763958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0541cc-5a68-4ab5-a533-a01bd384aa25 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.765354 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 14/27] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:29.771341 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c530-4ca3-4d51-bba2-b2a6452b1deb None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.771587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c530-4ca3-4d51-bba2-b2a6452b1deb None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.771873 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4c530-4ca3-4d51-bba2-b2a6452b1deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.780539 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb6f86-92b1-4c1b-b37d-759c8ff75da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:29.781422 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6f86-92b1-4c1b-b37d-759c8ff75da5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.781869 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6f86-92b1-4c1b-b37d-759c8ff75da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.782287 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6f86-92b1-4c1b-b37d-759c8ff75da5 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.783206 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6f86-92b1-4c1b-b37d-759c8ff75da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:29.783750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6f86-92b1-4c1b-b37d-759c8ff75da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:29.785370 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6f86-92b1-4c1b-b37d-759c8ff75da5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:29.794862 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 14/28] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:29.796669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019666e0-f1b7-4bab-b6c4-1ddde82f3b5d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.797133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019666e0-f1b7-4bab-b6c4-1ddde82f3b5d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.797554 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019666e0-f1b7-4bab-b6c4-1ddde82f3b5d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.798936 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 15/29] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:29.805468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-e4c4c530-4ca3-4d51-bba2-b2a6452b1deb None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:29.805468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e4c4c530-4ca3-4d51-bba2-b2a6452b1deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:29.806730 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019666e0-f1b7-4bab-b6c4-1ddde82f3b5d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:29.875643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 15/30] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:29.877375 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439722c-c86b-47f6-a37f-334d8a91fc04 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.877855 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439722c-c86b-47f6-a37f-334d8a91fc04 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.878368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439722c-c86b-47f6-a37f-334d8a91fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.889540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:29.899652 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5439722c-c86b-47f6-a37f-334d8a91fc04 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:29.901964 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5439722c-c86b-47f6-a37f-334d8a91fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:29.931311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019666e0-f1b7-4bab-b6c4-1ddde82f3b5d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:29.970034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:29.971021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:29.971452 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:29.971733 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] PATH_INFO: `/v3/users/f728f0a5a3434bf7868adf527331fd5c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:29.973127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] RBAC: Authorizing `identity:get_user(user_id=f728f0a5a3434bf7868adf527331fd5c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:29.974728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:29.976574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 16/31] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:29 2022] GET /identity/v3/users/f728f0a5a3434bf7868adf527331fd5c => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:29.977353 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:29.981600 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 16/32] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:29.988191 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439722c-c86b-47f6-a37f-334d8a91fc04 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:30.051612 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:30.087835 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112821a-8ec2-4332-84e2-cc1c4249d8ff None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:30.123199 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439722c-c86b-47f6-a37f-334d8a91fc04 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:30.123406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:30.123946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.124238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.124520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.125277 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:30.126691 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:30.129100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:30.169813 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:30.170945 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.171586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.172050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.172979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:30.174754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:30.253682 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 17/33] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 10:10:29 2022] POST /identity/v3/roles => generated 219 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:10:30.254671 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:30.308133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 17/34] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 10:10:29 2022] POST /identity/v3/roles => generated 225 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:10:30.309802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:30.432931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024764e-6d2a-4b26-8c86-204dc5e0cc83 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:30.482351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e038b0d-c0a8-428a-b302-e159e7d64b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:30.483667 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038b0d-c0a8-428a-b302-e159e7d64b30 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.483787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038b0d-c0a8-428a-b302-e159e7d64b30 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.484078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038b0d-c0a8-428a-b302-e159e7d64b30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.485970 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e038b0d-c0a8-428a-b302-e159e7d64b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:30.487507 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e038b0d-c0a8-428a-b302-e159e7d64b30 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:30.491500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 18/35] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:30.491500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f68b0-0753-4367-80eb-770610f6869f None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.493633 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f68b0-0753-4367-80eb-770610f6869f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.493633 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f68b0-0753-4367-80eb-770610f6869f None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.493798 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:30.495004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f68b0-0753-4367-80eb-770610f6869f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:30.545461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:30.552056 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487c84c-2606-4e1c-bba4-dd3e4a1daa44 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:30.580530 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:30.605477 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a778b9-9911-461d-8e59-8708b5ecf5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:30.607147 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a778b9-9911-461d-8e59-8708b5ecf5ba None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.607983 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a778b9-9911-461d-8e59-8708b5ecf5ba None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.608346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a778b9-9911-461d-8e59-8708b5ecf5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.622526 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a778b9-9911-461d-8e59-8708b5ecf5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:30.624438 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a778b9-9911-461d-8e59-8708b5ecf5ba None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:30.634287 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f68b0-0753-4367-80eb-770610f6869f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-81a778b9-9911-461d-8e59-8708b5ecf5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:10:30.643126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:30.644025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:30.644823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:10:30.644823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:10:30.644823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:10:30.644823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:30.644823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 18/37] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:30.647012 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64887b-ae7b-4f15-b6e5-8533d255376b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.647325 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64887b-ae7b-4f15-b6e5-8533d255376b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.647611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64887b-ae7b-4f15-b6e5-8533d255376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.665419 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-9f64887b-ae7b-4f15-b6e5-8533d255376b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:30.666958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-9f64887b-ae7b-4f15-b6e5-8533d255376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:30.676224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:30.677198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.677490 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.677835 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] PATH_INFO: `/v3/domains/default/users/f728f0a5a3434bf7868adf527331fd5c/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.680336 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f728f0a5a3434bf7868adf527331fd5c, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:30.682345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:30.701157 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 20/38] 10.222.0.67 () {58 vars in 1361 bytes} [Wed May 25 10:10:30 2022] PUT /identity/v3/domains/default/users/f728f0a5a3434bf7868adf527331fd5c/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:10:30.702043 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:30.761842 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 19/39] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:30.788651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64887b-ae7b-4f15-b6e5-8533d255376b None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:30.840188 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc07392-3cba-409e-8dc5-70d8d1c2a49a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:30.867857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:30.891600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:30.892693 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.893179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.893660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.895641 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:30.896236 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:30.898745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:30.902348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:30.930727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 21/40] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:30.936982 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:30.950135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64887b-ae7b-4f15-b6e5-8533d255376b None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:30.990672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ee58a-ce2d-4ec3-94b5-81622eb00613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:30.991467 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee58a-ce2d-4ec3-94b5-81622eb00613 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:30.991753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee58a-ce2d-4ec3-94b5-81622eb00613 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:30.992086 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ee58a-ce2d-4ec3-94b5-81622eb00613 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:30.992981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ee58a-ce2d-4ec3-94b5-81622eb00613 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:30.994392 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ee58a-ce2d-4ec3-94b5-81622eb00613 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:31.013690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 10:10:30 2022] POST /identity/v3/roles => generated 223 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:10:31.019051 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ea26-b4f1-4740-85c2-01f918a980ef None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:31.019384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ea26-b4f1-4740-85c2-01f918a980ef None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:31.019676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ea26-b4f1-4740-85c2-01f918a980ef None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:31.021078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 21/42] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:10:31.026803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38cd40-090f-47e9-a05c-64c143a60007 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:31.027159 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38cd40-090f-47e9-a05c-64c143a60007 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:31.027488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38cd40-090f-47e9-a05c-64c143a60007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:31.049434 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5e38cd40-090f-47e9-a05c-64c143a60007 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:31.051190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5e38cd40-090f-47e9-a05c-64c143a60007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:31.076763 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244f560-0b13-4e57-8d90-f37b9d242740 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:31.121662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:31.122481 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:31.122973 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:31.123388 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:31.124296 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:31.126017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:31.139128 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 22/43] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:31.164028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 22/44] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:10:30 2022] POST /identity/v3/projects => generated 301 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:10:31.169385 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38cd40-090f-47e9-a05c-64c143a60007 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:31.261132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:31.299918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38cd40-090f-47e9-a05c-64c143a60007 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:31.344954 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bacaf-5620-4906-91e1-3ab3b25afbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:31.345821 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bacaf-5620-4906-91e1-3ab3b25afbc1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:31.346108 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bacaf-5620-4906-91e1-3ab3b25afbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:31.346383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bacaf-5620-4906-91e1-3ab3b25afbc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:31.347976 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bacaf-5620-4906-91e1-3ab3b25afbc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:31.349474 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bacaf-5620-4906-91e1-3ab3b25afbc1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:31.351379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 23/45] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:31.356966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:31.394834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:31.464336 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba778d-b602-4178-a343-32291d03c6e0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:31.502741 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd363ee-2381-4384-b139-3b3733fc67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:31.503460 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd363ee-2381-4384-b139-3b3733fc67d5 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:31.503752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd363ee-2381-4384-b139-3b3733fc67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:31.504031 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd363ee-2381-4384-b139-3b3733fc67d5 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:31.504770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd363ee-2381-4384-b139-3b3733fc67d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:31.506259 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd363ee-2381-4384-b139-3b3733fc67d5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:31.533045 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 23/46] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:10:31 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:10:33.031500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31902-81ab-48d6-8041-87fcae67231e None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.032072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31902-81ab-48d6-8041-87fcae67231e None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.032072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf31902-81ab-48d6-8041-87fcae67231e None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.033405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 24/47] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:33.038814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b7214-a234-446a-8dd5-962dbef82750 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.039242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b7214-a234-446a-8dd5-962dbef82750 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.039449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b7214-a234-446a-8dd5-962dbef82750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.058123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-288b7214-a234-446a-8dd5-962dbef82750 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:33.059694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-288b7214-a234-446a-8dd5-962dbef82750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:33.130670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 24/48] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:33.156461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31902-81ab-48d6-8041-87fcae67231e None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:33.264686 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf31902-81ab-48d6-8041-87fcae67231e None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:33.299288 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:33.300119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.300402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.300678 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.304536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:33.313612 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:33.322629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:33.323565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:33.324300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 25/49] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:33.330067 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b7214-a234-446a-8dd5-962dbef82750 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:33.348695 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:33.435390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b7214-a234-446a-8dd5-962dbef82750 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:33.474548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:33.475235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.475560 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.475843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.476618 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:33.476936 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:33.478358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:33.487141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 25/50] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:33.492808 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:33.597902 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fe966-51ba-40ce-89d1-9bbcbef3a872 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:33.633134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:33.634027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.634286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.634589 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] PATH_INFO: `/v3/users/f728f0a5a3434bf7868adf527331fd5c` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.636095 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=f728f0a5a3434bf7868adf527331fd5c)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:33.637610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:33.639769 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 26/51] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:33 2022] GET /identity/v3/users/f728f0a5a3434bf7868adf527331fd5c => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:33.646012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:33.736488 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:33.759795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d553996-7219-43ff-b67f-e0298dff6729 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:33.793409 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4313dd-90e8-44e4-9942-f96b488de44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:33.794269 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4313dd-90e8-44e4-9942-f96b488de44f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.794557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4313dd-90e8-44e4-9942-f96b488de44f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.795015 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4313dd-90e8-44e4-9942-f96b488de44f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.796418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4313dd-90e8-44e4-9942-f96b488de44f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:33.797888 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4313dd-90e8-44e4-9942-f96b488de44f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:33.799762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 26/52] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:33.805840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:33.860384 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012ba24-eba5-441e-b8ba-b72b15ca67ef None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.860680 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012ba24-eba5-441e-b8ba-b72b15ca67ef None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.860972 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012ba24-eba5-441e-b8ba-b72b15ca67ef None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.862321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 27/53] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:33.867460 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b27c28-4c51-4f55-8dd2-5964b3b70a50 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.867932 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b27c28-4c51-4f55-8dd2-5964b3b70a50 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.868216 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b27c28-4c51-4f55-8dd2-5964b3b70a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.888090 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:33.888254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-44b27c28-4c51-4f55-8dd2-5964b3b70a50 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:33.889906 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-44b27c28-4c51-4f55-8dd2-5964b3b70a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:33.928933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9dcea-b426-48a1-aed5-8e6b0701e7b8 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:33.956564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 28/54] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:33.963498 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:33.964178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:33.964469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:33.964750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:33.965599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.domain.id=default, user.id=f728f0a5a3434bf7868adf527331fd5c) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:33.965917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:33.967659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:33.976383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1322 bytes} [Wed May 25 10:10:33 2022] GET /identity/v3/role_assignments?user.id=f728f0a5a3434bf7868adf527331fd5c&scope.domain.id=default&role.id=079434fe84194c03ae64e10d61e222e6 => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:33.982323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b27c28-4c51-4f55-8dd2-5964b3b70a50 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:34.070945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:34.098913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b27c28-4c51-4f55-8dd2-5964b3b70a50 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:34.137076 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980853a-14e6-4308-a945-3c77e6e996af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:34.137898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980853a-14e6-4308-a945-3c77e6e996af None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:34.138180 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980853a-14e6-4308-a945-3c77e6e996af None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:34.138458 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980853a-14e6-4308-a945-3c77e6e996af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:34.140373 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980853a-14e6-4308-a945-3c77e6e996af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:34.141863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980853a-14e6-4308-a945-3c77e6e996af None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:34.143569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 29/56] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:34.149504 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:34.264532 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0115c53-e619-4e93-a8c2-1c5ced5e5771 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:34.290746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:34.300526 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220b6dd-0817-4ead-a3f6-3f4077a10bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:34.301207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b6dd-0817-4ead-a3f6-3f4077a10bdb None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:34.301494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b6dd-0817-4ead-a3f6-3f4077a10bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:34.301780 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b6dd-0817-4ead-a3f6-3f4077a10bdb None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:34.302494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b6dd-0817-4ead-a3f6-3f4077a10bdb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:34.304003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b6dd-0817-4ead-a3f6-3f4077a10bdb None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:34.338305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 28/57] 10.222.0.67 () {60 vars in 1140 bytes} [Wed May 25 10:10:34 2022] POST /identity/v3/projects => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:10:36.694401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fd874-18df-4f81-83b6-e473fe1b2fba None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:36.695242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fd874-18df-4f81-83b6-e473fe1b2fba None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:36.695242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fd874-18df-4f81-83b6-e473fe1b2fba None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:36.697531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 30/58] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:36.702916 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb06a-2971-4e8f-93b6-18058f37b7c0 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:36.703353 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb06a-2971-4e8f-93b6-18058f37b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:36.703515 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bb06a-2971-4e8f-93b6-18058f37b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:36.722701 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-e01bb06a-2971-4e8f-93b6-18058f37b7c0 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:36.723905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e01bb06a-2971-4e8f-93b6-18058f37b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:36.792683 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 29/59] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:36.823123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fd874-18df-4f81-83b6-e473fe1b2fba None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:36.932834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fd874-18df-4f81-83b6-e473fe1b2fba None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:36.971619 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27af87-69bf-45d6-a861-5eaba2f5a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:36.972346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27af87-69bf-45d6-a861-5eaba2f5a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:36.972635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27af87-69bf-45d6-a861-5eaba2f5a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:36.972913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27af87-69bf-45d6-a861-5eaba2f5a3d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:36.974220 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27af87-69bf-45d6-a861-5eaba2f5a3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:36.975735 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27af87-69bf-45d6-a861-5eaba2f5a3d0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:36.977354 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 31/60] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:36.984070 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb06a-2971-4e8f-93b6-18058f37b7c0 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:37.103584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bb06a-2971-4e8f-93b6-18058f37b7c0 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:37.115322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:37.147069 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0f46d-5b0e-4895-8f3b-f0ddb89dda6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:37.147788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f46d-5b0e-4895-8f3b-f0ddb89dda6b None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:37.148072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f46d-5b0e-4895-8f3b-f0ddb89dda6b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:37.148348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0f46d-5b0e-4895-8f3b-f0ddb89dda6b None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:37.149068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f46d-5b0e-4895-8f3b-f0ddb89dda6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:37.150552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0f46d-5b0e-4895-8f3b-f0ddb89dda6b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:37.187407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 30/61] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:10:36 2022] POST /identity/v3/users => generated 275 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:10:40.641767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529b7b2-1a00-413a-bb5c-a2ea1c9ffb69 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:40.642303 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529b7b2-1a00-413a-bb5c-a2ea1c9ffb69 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:40.642603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529b7b2-1a00-413a-bb5c-a2ea1c9ffb69 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:40.644296 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 32/62] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:40.650187 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f75bc-4af7-4139-88bd-1d0b1dd568ac None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:40.651066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f75bc-4af7-4139-88bd-1d0b1dd568ac None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:40.651587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f75bc-4af7-4139-88bd-1d0b1dd568ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:40.673613 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-ac7f75bc-4af7-4139-88bd-1d0b1dd568ac None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:40.675170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-ac7f75bc-4af7-4139-88bd-1d0b1dd568ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:40.769265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 31/63] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:40.818610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529b7b2-1a00-413a-bb5c-a2ea1c9ffb69 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:40.838275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:40.947957 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb408bb-8130-440a-a67f-8b67f6d3e99c None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:40.948354 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb408bb-8130-440a-a67f-8b67f6d3e99c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:40.948535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb408bb-8130-440a-a67f-8b67f6d3e99c None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:40.949929 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 32/64] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:10:40.956631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7bf9-3241-43b9-bea1-b5d14dcaaa20 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:40.957235 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7bf9-3241-43b9-bea1-b5d14dcaaa20 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:40.957749 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a7bf9-3241-43b9-bea1-b5d14dcaaa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:40.986622 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-a06a7bf9-3241-43b9-bea1-b5d14dcaaa20 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:40.987877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-a06a7bf9-3241-43b9-bea1-b5d14dcaaa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:40.989205 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529b7b2-1a00-413a-bb5c-a2ea1c9ffb69 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.044764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a18bf-2ab8-4a04-a248-3f15c1087600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.046982 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a18bf-2ab8-4a04-a248-3f15c1087600 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.047489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a18bf-2ab8-4a04-a248-3f15c1087600 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.047927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a18bf-2ab8-4a04-a248-3f15c1087600 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.059600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a18bf-2ab8-4a04-a248-3f15c1087600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-600a18bf-2ab8-4a04-a248-3f15c1087600 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:41.069553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:41.070485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:41.071421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:10:41.073746 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 33/65] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:41.075516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8ba1b-99fc-4d50-a3ef-1dc0406f9366 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.075989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8ba1b-99fc-4d50-a3ef-1dc0406f9366 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.076586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8ba1b-99fc-4d50-a3ef-1dc0406f9366 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.078947 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 34/66] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:41.085026 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ca7cf-447f-4f35-acd7-b32a6af5cfc9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.085587 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ca7cf-447f-4f35-acd7-b32a6af5cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.086008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ca7cf-447f-4f35-acd7-b32a6af5cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.089583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 33/67] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:41.090561 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a7bf9-3241-43b9-bea1-b5d14dcaaa20 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.118941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1c8ca7cf-447f-4f35-acd7-b32a6af5cfc9 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:41.120212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1c8ca7cf-447f-4f35-acd7-b32a6af5cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:41.121113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.198624 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 35/68] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:41.200640 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a7bf9-3241-43b9-bea1-b5d14dcaaa20 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.200823 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d65db-c0f0-486c-95bd-af5ee376da37 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.201351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d65db-c0f0-486c-95bd-af5ee376da37 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.201810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d65db-c0f0-486c-95bd-af5ee376da37 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.204797 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 36/69] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:41.205742 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d65db-c0f0-486c-95bd-af5ee376da37 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.208885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.243743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f9adf-16d2-4014-b88e-97e71c9b208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.244438 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f9adf-16d2-4014-b88e-97e71c9b208d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.244698 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f9adf-16d2-4014-b88e-97e71c9b208d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.244982 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f9adf-16d2-4014-b88e-97e71c9b208d None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.245758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f9adf-16d2-4014-b88e-97e71c9b208d None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:41.246078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f9adf-16d2-4014-b88e-97e71c9b208d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:41.247564 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f9adf-16d2-4014-b88e-97e71c9b208d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:41.262203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 34/70] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:41.262445 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5240e1-7d3f-43e8-8abc-9d77d96db3f7 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.262907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5240e1-7d3f-43e8-8abc-9d77d96db3f7 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.263193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5240e1-7d3f-43e8-8abc-9d77d96db3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.280385 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-4e5240e1-7d3f-43e8-8abc-9d77d96db3f7 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:41.281646 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-4e5240e1-7d3f-43e8-8abc-9d77d96db3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:41.324262 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d65db-c0f0-486c-95bd-af5ee376da37 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.348242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 35/71] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:41.348896 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5240e1-7d3f-43e8-8abc-9d77d96db3f7 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.366893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.368691 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.369713 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.369948 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.370289 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.381920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:41.390204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:41.391028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:10:41.391841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 37/72] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:41.392648 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.451794 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5240e1-7d3f-43e8-8abc-9d77d96db3f7 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.456802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.485709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e439b-ed5d-42eb-9160-231d6740dab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.486518 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e439b-ed5d-42eb-9160-231d6740dab1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.486823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e439b-ed5d-42eb-9160-231d6740dab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.487092 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e439b-ed5d-42eb-9160-231d6740dab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.495579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f25d2-2a00-49d7-90de-7d81271e3a5e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.497377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e439b-ed5d-42eb-9160-231d6740dab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-a19e439b-ed5d-42eb-9160-231d6740dab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:41.505025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:41.505886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:41.506636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:41.507653 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a088-aabe-4dfb-b19e-04c023e0de73 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.507889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a088-aabe-4dfb-b19e-04c023e0de73 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.508170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a088-aabe-4dfb-b19e-04c023e0de73 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.509427 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 37/74] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:41.510177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a088-aabe-4dfb-b19e-04c023e0de73 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.536635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.537533 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.537820 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.538100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.551403 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:41.552904 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:41.554592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 38/75] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:41.555393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.594690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.618936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a088-aabe-4dfb-b19e-04c023e0de73 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.652599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.653426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.653713 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.653994 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.655179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a33bd6-b373-4ffc-a72f-1cb1144656be None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.655577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:41.656834 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:41.658655 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 38/76] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:41.659253 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.675460 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.690937 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c1a6f-5fc7-4e09-ae86-fc9e85a8a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.691973 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c1a6f-5fc7-4e09-ae86-fc9e85a8a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.692413 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c1a6f-5fc7-4e09-ae86-fc9e85a8a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.692827 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c1a6f-5fc7-4e09-ae86-fc9e85a8a8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.694037 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c1a6f-5fc7-4e09-ae86-fc9e85a8a8e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:41.694623 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c1a6f-5fc7-4e09-ae86-fc9e85a8a8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:41.696506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c1a6f-5fc7-4e09-ae86-fc9e85a8a8e6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:41.705771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 39/77] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:41.706727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eb932-c802-40d0-945a-df82036f65b3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.706994 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eb932-c802-40d0-945a-df82036f65b3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.707300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434eb932-c802-40d0-945a-df82036f65b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.723294 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-434eb932-c802-40d0-945a-df82036f65b3 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:41.724519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-434eb932-c802-40d0-945a-df82036f65b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:41.765679 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c61f0-a7ef-460f-81f6-38e07b3f73e4 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.796243 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 40/78] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:41.796787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434eb932-c802-40d0-945a-df82036f65b3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.802901 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.803688 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.803975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.804257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.805018 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:41.805329 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:41.806863 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:41.816021 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 39/79] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:41.816733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:41.830866 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.902008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434eb932-c802-40d0-945a-df82036f65b3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.914754 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:41.919778 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a88f1-01e8-4e0a-b2f0-4be6ceaef8cb None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:41.936731 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.937402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.937691 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.937976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.953487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:41.954161 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:41.954446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:41.954727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:41.955476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:41.957008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:41.977121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 40/80] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:10:41 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:10:41.980239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.012846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:42.014545 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:42.053006 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:42.103519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72cfa6-32c1-4be9-88b1-3a30707fbf60 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:42.142073 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 41/81] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:42.147885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.150338 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:42.151483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:42.151839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:42.152191 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:42.153588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:42.155957 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:42.157691 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 41/82] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:41 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:42.158555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.169357 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:42.277793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bf150-e112-43e4-bcf2-ad40d23512da None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:42.281636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37064409-8e53-4fb3-a8f8-2e316c58b83f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:42.318408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:42.322700 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:42.323608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:42.324005 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:42.324297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:42.324482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:42.325391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:42.325677 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:42.325959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] PATH_INFO: `/v3/users/f728f0a5a3434bf7868adf527331fd5c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:42.328041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] RBAC: Authorizing `identity:get_user(user_id=f728f0a5a3434bf7868adf527331fd5c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:42.330346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:42.330980 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 42/83] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/users/f728f0a5a3434bf7868adf527331fd5c => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:42.332363 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.343513 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:42.352651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:42.353488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:42.354666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 42/84] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:42.355597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.431544 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:42.453110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50ad8-fe64-462a-97cc-4a2ecfcdbc3a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:42.476865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f3e1d-8b0c-4a09-be0d-10d15e142631 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:42.490437 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:42.491374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:42.491671 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:42.492061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:42.493433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:42.494971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:42.497326 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 43/85] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:42.498312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.516241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:42.516966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:42.517256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:42.517535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:42.599889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:42.613781 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:42.614512 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3373a85-ca67-49b0-915a-71ebe047cde4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:42.615468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:42.666016 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:42.666774 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:42.667160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:42.667795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:42.697993 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:42.746580 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 43/86] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:42.748067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.761435 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:42.763321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:42.855685 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:42.866290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325bc70-1945-44e2-ba8d-ab0742d1eebb None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:42.900006 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 44/87] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:42.900975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.903540 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:42.904532 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:42.905046 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:42.905576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:42.906520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:42.907017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:42.908648 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:42.917908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 44/88] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:42.919017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:42.988628 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:43.032438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0288c-1695-44f2-933b-756cda11c95d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:43.050009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c141b7-6977-4ad1-b59a-6bdeb446b974 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:43.068466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:43.069340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:43.069762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:43.070175 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:43.071138 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=89587fceb82a48d69851e13e14ad9293) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:43.071627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:43.073252 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:43.079039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 45/89] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/role_assignments?user.id=89587fceb82a48d69851e13e14ad9293&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:43.080077 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:43.095766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:43.096818 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:43.097082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:43.097436 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:43.099026 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:43.101466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:43.103656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 45/90] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:42 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:43.104983 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:43.140999 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:43.221801 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eef878-50fc-45ce-9d41-49876726184b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:43.228014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec78d6-9aff-4af1-80d3-e5762b2074c7 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:43.241159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:43.283426 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:43.285131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:43.285643 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:43.286124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:43.287862 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:43.289820 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:43.291838 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 46/91] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:43 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:43.292913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:43.313135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:43.314434 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:43.314710 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:43.314990 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:43.316357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:43.317870 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:43.319892 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 46/92] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:43 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:43.320554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:43.423021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970e5a3-8829-4623-92a8-9c9e847cf073 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:43.460156 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:43.461315 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:43.461800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:43.462314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:43.463369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] RBAC: Adding query filter params (role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=89587fceb82a48d69851e13e14ad9293) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:43.463895 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:43.465548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:43.471955 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 47/93] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:43 2022] GET /identity/v3/role_assignments?user.id=89587fceb82a48d69851e13e14ad9293&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=81307e0920ce427d9422f90d0da01275 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:43.473208 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:43.497112 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:43.509131 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285261-8f3d-411e-bbe1-6d2073648179 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:43.524618 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:43.549523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:43.550131 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:43.550417 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:43.550699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:43.551617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=f728f0a5a3434bf7868adf527331fd5c) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:43.552385 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:43.553545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:43.560194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 47/94] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:43 2022] GET /identity/v3/role_assignments?user.id=f728f0a5a3434bf7868adf527331fd5c&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=079434fe84194c03ae64e10d61e222e6 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:43.593980 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0a18-7650-4f7b-b50b-4005f44f04fe None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:43.634225 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:43.635374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:43.635885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:43.636361 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:43.716387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:43.718771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:43.769133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:43.831976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 48/95] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:43.838703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:43.979680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85971046-5281-48f9-923a-d29cf2f9c33d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:44.022091 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1befc-f3e7-461b-8bdc-7162f80d4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:44.022981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1befc-f3e7-461b-8bdc-7162f80d4d2b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:44.023264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1befc-f3e7-461b-8bdc-7162f80d4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:44.023563 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1befc-f3e7-461b-8bdc-7162f80d4d2b None admin] PATH_INFO: `/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:44.024757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1befc-f3e7-461b-8bdc-7162f80d4d2b None admin] RBAC: Authorizing `identity:get_project(project_id=fc9da971e3ed44cb8cb4bbab81fdf726)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:44.026247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1befc-f3e7-461b-8bdc-7162f80d4d2b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:44.027982 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 48/96] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:43 2022] GET /identity/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:44.034124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:44.137426 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aaeb4-3340-4e92-bd7d-8a88debfff12 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:44.173821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae64387-805e-47c4-8acc-fee63104f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:44.174501 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae64387-805e-47c4-8acc-fee63104f563 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:44.174787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae64387-805e-47c4-8acc-fee63104f563 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:44.175067 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae64387-805e-47c4-8acc-fee63104f563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:44.175951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae64387-805e-47c4-8acc-fee63104f563 None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=fc9da971e3ed44cb8cb4bbab81fdf726, user.id=89587fceb82a48d69851e13e14ad9293) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:44.176264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae64387-805e-47c4-8acc-fee63104f563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:44.177734 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae64387-805e-47c4-8acc-fee63104f563 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:44.183892 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 49/97] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:44 2022] GET /identity/v3/role_assignments?user.id=89587fceb82a48d69851e13e14ad9293&scope.project.id=fc9da971e3ed44cb8cb4bbab81fdf726&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:44.921653 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ed6f-e2af-4fb0-9554-3b81a01d4c90 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:44.922659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ed6f-e2af-4fb0-9554-3b81a01d4c90 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:44.923137 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94ed6f-e2af-4fb0-9554-3b81a01d4c90 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:44.924860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 49/98] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:44.930552 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef819c-1ff4-4bd1-8e64-4fddcfcb6831 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:44.931464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef819c-1ff4-4bd1-8e64-4fddcfcb6831 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:44.931964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef819c-1ff4-4bd1-8e64-4fddcfcb6831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:44.934642 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f443d-ac61-4ed9-aa12-cd99a9acc19b None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:44.935140 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f443d-ac61-4ed9-aa12-cd99a9acc19b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:44.935804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f443d-ac61-4ed9-aa12-cd99a9acc19b None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:44.937539 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 50/99] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:10:44.946465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713fc07-8978-4bdb-8d35-d113dd2f2101 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:44.947040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713fc07-8978-4bdb-8d35-d113dd2f2101 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:44.947536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713fc07-8978-4bdb-8d35-d113dd2f2101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:44.976098 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-3713fc07-8978-4bdb-8d35-d113dd2f2101 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:44.977358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5cef819c-1ff4-4bd1-8e64-4fddcfcb6831 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:44.978773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-3713fc07-8978-4bdb-8d35-d113dd2f2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:44.980181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5cef819c-1ff4-4bd1-8e64-4fddcfcb6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:44.985523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:45.027682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:45.054180 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 50/100] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:45.062367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 51/101] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:45.112762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef819c-1ff4-4bd1-8e64-4fddcfcb6831 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:45.118436 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713fc07-8978-4bdb-8d35-d113dd2f2101 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:45.230987 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713fc07-8978-4bdb-8d35-d113dd2f2101 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:45.259167 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef819c-1ff4-4bd1-8e64-4fddcfcb6831 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:45.305250 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:45.306444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:45.306937 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:45.307446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:45.325717 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:45.333762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:45.335103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:45.335639 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:45.336126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:45.337518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:45.339223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:45.344080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 51/102] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:45.346446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:45.347364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:10:45.348136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:45.354909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:45.360435 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 52/103] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:45.371602 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:45.371752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:45.391056 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:45.503025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78791c9-9081-4377-b2e7-a901968a822d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:45.538684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:45.539775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:45.540284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:45.540756 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:45.541721 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:45.542299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:45.543946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:45.553805 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 53/104] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:45.559644 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:45.615300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605a0e0-e034-44d3-bfe5-4843fcba9bd6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:45.691298 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:45.708612 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:45.709317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:45.709611 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:45.709896 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:45.710825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:45.712341 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:45.743186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c1791-b3ab-4399-8277-444333496994 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:45.768919 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 52/105] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:10:45 2022] POST /identity/v3/projects => generated 302 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:10:45.817457 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:45.824297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:45.824802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:45.825291 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] PATH_INFO: `/v3/users/10ad18e99b01476c9612271ad51e45f8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:45.849662 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] RBAC: Authorizing `identity:get_user(user_id=10ad18e99b01476c9612271ad51e45f8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:45.851566 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:45.853530 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 54/106] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:45 2022] GET /identity/v3/users/10ad18e99b01476c9612271ad51e45f8 => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:45.859499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:45.950735 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:45.996372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1afcd-4289-4da0-9107-3db12611882c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:46.032832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:46.033514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:46.033808 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:46.034094 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:46.113117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:46.115525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:46.195235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:46.242094 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 53/107] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:46.247621 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:46.397521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db4e04-55c6-47a1-b950-6a5444a5dfe4 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:46.428829 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:46.440809 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609397a0-e5c5-4572-8843-1108d630e80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:46.441910 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609397a0-e5c5-4572-8843-1108d630e80d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:46.442262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609397a0-e5c5-4572-8843-1108d630e80d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:46.442724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609397a0-e5c5-4572-8843-1108d630e80d None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:46.443983 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609397a0-e5c5-4572-8843-1108d630e80d None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:46.445477 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609397a0-e5c5-4572-8843-1108d630e80d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:46.447554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 55/108] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:46 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:46.453383 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:46.591241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad31675-1958-4691-911e-f059a6c040a2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:46.625924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af701f-0804-4311-9cf0-1555c3e2e763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:46.626607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af701f-0804-4311-9cf0-1555c3e2e763 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:46.626899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af701f-0804-4311-9cf0-1555c3e2e763 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:46.627183 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af701f-0804-4311-9cf0-1555c3e2e763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:46.628072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af701f-0804-4311-9cf0-1555c3e2e763 None admin] RBAC: Adding query filter params (role.id=664d5ea3869d4279ad66bd535835eecf, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=10ad18e99b01476c9612271ad51e45f8) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:46.628391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af701f-0804-4311-9cf0-1555c3e2e763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:46.629872 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af701f-0804-4311-9cf0-1555c3e2e763 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:46.635814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 54/109] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:46 2022] GET /identity/v3/role_assignments?user.id=10ad18e99b01476c9612271ad51e45f8&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=664d5ea3869d4279ad66bd535835eecf => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:47.118721 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea59f2-740d-40df-8d50-08a6f42759ee None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.119492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea59f2-740d-40df-8d50-08a6f42759ee None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.120008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea59f2-740d-40df-8d50-08a6f42759ee None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.121596 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 56/110] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:47.127463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba767867-ae5d-465f-8082-b2c074720791 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.128367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba767867-ae5d-465f-8082-b2c074720791 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.128848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba767867-ae5d-465f-8082-b2c074720791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.131856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd802ce-0237-4bc3-9703-5213f15998ad None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.132713 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd802ce-0237-4bc3-9703-5213f15998ad None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.133729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd802ce-0237-4bc3-9703-5213f15998ad None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.136343 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 57/111] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:47.142014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b24eb-d662-43ab-9855-04d9a47a9d73 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.142557 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b24eb-d662-43ab-9855-04d9a47a9d73 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.143812 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b24eb-d662-43ab-9855-04d9a47a9d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.156259 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ba767867-ae5d-465f-8082-b2c074720791 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:47.157500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ba767867-ae5d-465f-8082-b2c074720791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:47.162626 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-068b24eb-d662-43ab-9855-04d9a47a9d73 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:47.163849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-068b24eb-d662-43ab-9855-04d9a47a9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:47.178483 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:47.277305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 55/112] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:47.278677 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13551af5-19f2-4d93-a931-a00bbd3a5527 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.278971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13551af5-19f2-4d93-a931-a00bbd3a5527 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.279356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13551af5-19f2-4d93-a931-a00bbd3a5527 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.280639 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 56/113] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:47.281091 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 58/114] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:47.288516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6433f-1658-427d-8d3d-80bf7a984879 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.288986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6433f-1658-427d-8d3d-80bf7a984879 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.289424 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6433f-1658-427d-8d3d-80bf7a984879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.305101 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b24eb-d662-43ab-9855-04d9a47a9d73 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:47.313659 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c2c6433f-1658-427d-8d3d-80bf7a984879 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:47.315237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c2c6433f-1658-427d-8d3d-80bf7a984879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:47.440596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 57/115] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:47.441852 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6433f-1658-427d-8d3d-80bf7a984879 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:47.449887 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b24eb-d662-43ab-9855-04d9a47a9d73 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:47.519838 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:47.520564 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.520923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.521271 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.527849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:47.538818 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:47.547294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:47.548154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:47.548903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 59/116] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:10:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:10:47.549606 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:47.596547 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:47.610006 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6433f-1658-427d-8d3d-80bf7a984879 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:47.657375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:47.658429 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.658866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.659249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.672941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:47.681346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:47.682198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:10:47.682949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 58/117] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:10:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:47.683618 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:47.691406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03999d-5402-478c-9d02-e23383c59401 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:47.727381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961dab30-a122-4127-b7ca-bd739cc78b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:47.728560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dab30-a122-4127-b7ca-bd739cc78b1f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.729058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dab30-a122-4127-b7ca-bd739cc78b1f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.729429 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961dab30-a122-4127-b7ca-bd739cc78b1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.740326 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961dab30-a122-4127-b7ca-bd739cc78b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-961dab30-a122-4127-b7ca-bd739cc78b1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:47.748500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:47.749390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:47.750152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 60/118] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:47.755826 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ad59-d716-434f-8f01-53c4149c52e8 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.756232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ad59-d716-434f-8f01-53c4149c52e8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.756596 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2ad59-d716-434f-8f01-53c4149c52e8 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.758018 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 61/119] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:47.762743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2ad59-d716-434f-8f01-53c4149c52e8 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:47.808784 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabe732-e566-4af5-976f-6039c9863536 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:47.816756 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:47.864521 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:47.865545 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.866009 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.866999 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.868233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:47.868732 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:47.871039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:47.880908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2ad59-d716-434f-8f01-53c4149c52e8 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:47.884137 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 59/120] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:47.885168 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:47.928431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f622a98-4fc3-4127-84e4-2a1e7e62f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:47.929513 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622a98-4fc3-4127-84e4-2a1e7e62f561 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.930369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622a98-4fc3-4127-84e4-2a1e7e62f561 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.930876 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622a98-4fc3-4127-84e4-2a1e7e62f561 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.932175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f622a98-4fc3-4127-84e4-2a1e7e62f561 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:47.932938 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f622a98-4fc3-4127-84e4-2a1e7e62f561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:47.934784 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f622a98-4fc3-4127-84e4-2a1e7e62f561 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:47.947788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 62/121] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:10:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:47.947952 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:47.950083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c68a2-13f4-4ce3-ba4f-94fcaa40ad70 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:47.950577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c68a2-13f4-4ce3-ba4f-94fcaa40ad70 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:47.951110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c68a2-13f4-4ce3-ba4f-94fcaa40ad70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:47.972816 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-3b1c68a2-13f4-4ce3-ba4f-94fcaa40ad70 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:47.974038 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-3b1c68a2-13f4-4ce3-ba4f-94fcaa40ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:47.994277 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e2f17-e2c0-4246-a99c-d4340628e11b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.036308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.037009 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.037303 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.037593 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.038761 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:48.039079 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.040523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.058666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 60/122] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.058666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.062389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 63/123] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:48.063562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c68a2-13f4-4ce3-ba4f-94fcaa40ad70 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.129142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.140804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.182697 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2b311-9d25-4fff-ab10-5f4fe7f46ee6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.203099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c68a2-13f4-4ce3-ba4f-94fcaa40ad70 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.222162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.223578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.224372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.224720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] PATH_INFO: `/v3/users/f728f0a5a3434bf7868adf527331fd5c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.226378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] RBAC: Authorizing `identity:get_user(user_id=f728f0a5a3434bf7868adf527331fd5c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.229639 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.236257 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 61/124] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/users/f728f0a5a3434bf7868adf527331fd5c => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.237457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.246514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.247455 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.247750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.248211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.249634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.251785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.253936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 64/125] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.254716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.355625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe62db-3b2f-4835-9553-c3b1fded5338 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.372413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f9a0b-c23f-4613-95e6-7c5db29cdafd None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.385524 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.400632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.402088 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.402451 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.402963 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.404697 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.406967 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.414131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 62/126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.414131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.414131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.419556 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.420788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.421263 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.421749 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] PATH_INFO: `/v3/roles/member` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.433298 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:48.442001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:48.442845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:48.443965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:48.446790 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 65/127] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:48.447825 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.529411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60044602-804b-4ace-bc5f-2bebce1d07d6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.565990 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.567234 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.567774 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.568292 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.569705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.571448 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.573539 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 63/128] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.574506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.592840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfbd3d-ee30-45fa-9340-a2d3e2bfccac None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.639227 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.640538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.640837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.641123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.642674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.644203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.646841 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 66/129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.647795 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.649815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.686922 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda2870-9c7f-46ce-87fa-fad8a7d090db None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.698493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.734127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.735478 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.735956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.736451 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.737995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.739761 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.746745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 64/130] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.747898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.767013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872931a2-1122-4c4c-b457-5c12be0a34fe None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.816239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.816876 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.817166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.817482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.818834 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:48.819333 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.821251 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.834503 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 67/131] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:48.839416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.869103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cda7c-93c2-455e-8449-84b1b363dc1a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:48.905026 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:48.906457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:48.906954 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:48.907493 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/f728f0a5a3434bf7868adf527331fd5c/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:48.909684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] RBAC: Authorizing `identity:create_grant(project_id=077c4e535ff6468b8dd7e3cb78766c74, user_id=f728f0a5a3434bf7868adf527331fd5c, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:48.911474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:48.922687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.929944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 65/132] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:10:48 2022] PUT /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/f728f0a5a3434bf7868adf527331fd5c/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:10:48.931162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:48.970140 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:48.974439 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d38aff-1bbd-4911-a9df-6918f6b9d72f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:49.015125 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:49.016550 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.017232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.017737 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/89587fceb82a48d69851e13e14ad9293/roles/81307e0920ce427d9422f90d0da01275` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.022379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] RBAC: Authorizing `identity:create_grant(project_id=077c4e535ff6468b8dd7e3cb78766c74, user_id=89587fceb82a48d69851e13e14ad9293, role_id=81307e0920ce427d9422f90d0da01275)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:49.024481 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:49.067046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1fe6b-f81c-4535-99a1-997959bf861d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:49.068004 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 68/133] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:10:48 2022] PUT /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/89587fceb82a48d69851e13e14ad9293/roles/81307e0920ce427d9422f90d0da01275 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:10:49.069073 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:49.117786 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabfaf9-f785-4876-86c0-63844db943de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:49.119419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabfaf9-f785-4876-86c0-63844db943de None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.119756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabfaf9-f785-4876-86c0-63844db943de None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.120049 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabfaf9-f785-4876-86c0-63844db943de None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/89587fceb82a48d69851e13e14ad9293/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.122653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabfaf9-f785-4876-86c0-63844db943de None admin] RBAC: Authorizing `identity:create_grant(project_id=077c4e535ff6468b8dd7e3cb78766c74, user_id=89587fceb82a48d69851e13e14ad9293, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:49.124726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabfaf9-f785-4876-86c0-63844db943de None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:49.145355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 66/134] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:10:48 2022] PUT /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/89587fceb82a48d69851e13e14ad9293/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:10:49.151226 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac14f3-d4c5-4549-b9e1-a43cfa1d8e54 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.151226 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac14f3-d4c5-4549-b9e1-a43cfa1d8e54 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.151226 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac14f3-d4c5-4549-b9e1-a43cfa1d8e54 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.151226 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 67/135] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:49.156084 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9ba9f-8011-449c-8867-d82bae8c65b9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.156393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9ba9f-8011-449c-8867-d82bae8c65b9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.156664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9ba9f-8011-449c-8867-d82bae8c65b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.180606 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-13d9ba9f-8011-449c-8867-d82bae8c65b9 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:49.182585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-13d9ba9f-8011-449c-8867-d82bae8c65b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:49.226300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5278aa9-5d24-4cbf-b885-9cd6f33edb82 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:49.278178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:49.279152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.279500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.279779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.281152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:49.282537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:49.282729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:49.284922 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 69/136] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:49 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:49.290918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:49.302152 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 68/137] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:49.336472 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9ba9f-8011-449c-8867-d82bae8c65b9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:49.345282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:49.473327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd407-edd5-4e4c-9c52-7fec1ed61bbc None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:49.476356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9ba9f-8011-449c-8867-d82bae8c65b9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:49.520583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:49.521485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.521762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.522037 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] PATH_INFO: `/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.522799 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:49.523261 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] RBAC: Authorizing `identity:get_project(project_id=fc9da971e3ed44cb8cb4bbab81fdf726)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:49.523976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.524417 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.524810 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:49.525004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.526460 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:49.526645 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 70/138] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:49 2022] GET /identity/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:49.531250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:49.533585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 69/139] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:49.533733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:49.539551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:49.614355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:49.694705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe9316-ce1e-4ab0-a08c-fdd17df2cee9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:49.736139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:49.738389 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac42a84-2833-4574-bcf0-85f0118985c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:49.739372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac42a84-2833-4574-bcf0-85f0118985c1 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.739807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac42a84-2833-4574-bcf0-85f0118985c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.740221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac42a84-2833-4574-bcf0-85f0118985c1 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.741956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac42a84-2833-4574-bcf0-85f0118985c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:49.742964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac42a84-2833-4574-bcf0-85f0118985c1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:49.746471 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be275-b792-4c35-ab8b-5f917372497e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:49.774283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 70/140] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:10:49 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:10:49.779779 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c89296-799f-4c2d-b51b-7527d5c2f101 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.780373 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c89296-799f-4c2d-b51b-7527d5c2f101 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.780917 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c89296-799f-4c2d-b51b-7527d5c2f101 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.782630 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 71/141] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:49.789906 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c244e-e075-48ac-a81f-cc2fa49bfb15 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.790580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c244e-e075-48ac-a81f-cc2fa49bfb15 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.790860 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c244e-e075-48ac-a81f-cc2fa49bfb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.808262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:49.809583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:49.810053 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:49.810652 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] PATH_INFO: `/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726/users/89587fceb82a48d69851e13e14ad9293/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:49.813419 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] RBAC: Authorizing `identity:create_grant(project_id=fc9da971e3ed44cb8cb4bbab81fdf726, user_id=89587fceb82a48d69851e13e14ad9293, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:49.815819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:49.821696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9c0c244e-e075-48ac-a81f-cc2fa49bfb15 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:49.821696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9c0c244e-e075-48ac-a81f-cc2fa49bfb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:49.849856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 71/142] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:10:49 2022] PUT /identity/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726/users/89587fceb82a48d69851e13e14ad9293/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:10:49.908160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 72/143] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:49.934854 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:50.057350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022688e0-7efe-4a3c-8b63-b56aba8de0ed None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:50.102507 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:50.103483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:50.103842 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:50.104196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:50.123463 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:50.131389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:50.132584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:10:50.133552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:50.134959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 72/144] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:10:50.141979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c244e-e075-48ac-a81f-cc2fa49bfb15 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:50.190345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:50.254538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c244e-e075-48ac-a81f-cc2fa49bfb15 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:50.293928 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:50.294628 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:50.295123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:50.295564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:50.296371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:50.297092 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:50.298128 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:50.307827 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 73/145] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:50.315484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:50.338646 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:50.443451 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60279726-be47-44ee-890c-8668b6d0581a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:50.486930 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:50.487959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:50.488245 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:50.488527 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] PATH_INFO: `/v3/users/10ad18e99b01476c9612271ad51e45f8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:50.489856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] RBAC: Authorizing `identity:get_user(user_id=10ad18e99b01476c9612271ad51e45f8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:50.491687 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:50.493758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 73/146] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:50 2022] GET /identity/v3/users/10ad18e99b01476c9612271ad51e45f8 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:50.499660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:50.616608 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b5a93-f86d-497a-8dbe-b14fba46dad7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:50.619033 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:50.659563 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891facfb-54eb-4a16-961f-e6272c2a014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:50.660511 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891facfb-54eb-4a16-961f-e6272c2a014f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:50.660794 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891facfb-54eb-4a16-961f-e6272c2a014f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:50.661069 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891facfb-54eb-4a16-961f-e6272c2a014f None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:50.662320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891facfb-54eb-4a16-961f-e6272c2a014f None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:50.663839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891facfb-54eb-4a16-961f-e6272c2a014f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:50.665704 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 74/147] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:50 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:50.671488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:50.766775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:50.784814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a310b-4b79-4ff1-aad0-bbd76b7e0be0 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:50.823081 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bcfc2-3299-488c-b777-c440ec088237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:50.824104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bcfc2-3299-488c-b777-c440ec088237 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:50.824445 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bcfc2-3299-488c-b777-c440ec088237 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:50.824814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bcfc2-3299-488c-b777-c440ec088237 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/10ad18e99b01476c9612271ad51e45f8/roles/664d5ea3869d4279ad66bd535835eecf` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:50.827555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bcfc2-3299-488c-b777-c440ec088237 None admin] RBAC: Authorizing `identity:create_grant(project_id=077c4e535ff6468b8dd7e3cb78766c74, user_id=10ad18e99b01476c9612271ad51e45f8, role_id=664d5ea3869d4279ad66bd535835eecf)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:50.829058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bcfc2-3299-488c-b777-c440ec088237 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:50.846597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 74/148] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:10:50 2022] PUT /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/users/10ad18e99b01476c9612271ad51e45f8/roles/664d5ea3869d4279ad66bd535835eecf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:10:52.666522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22468c65-8e5a-46d4-91e8-79f8fd7f896b None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:52.667073 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22468c65-8e5a-46d4-91e8-79f8fd7f896b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:52.667147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22468c65-8e5a-46d4-91e8-79f8fd7f896b None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:52.668788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 75/149] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:52.680996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b886-3a71-424f-8e41-39ebcf906593 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:52.681472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b886-3a71-424f-8e41-39ebcf906593 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:52.681542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373b886-3a71-424f-8e41-39ebcf906593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:52.704280 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-6373b886-3a71-424f-8e41-39ebcf906593 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:52.705500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-6373b886-3a71-424f-8e41-39ebcf906593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:52.776395 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 75/150] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:52.802979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22468c65-8e5a-46d4-91e8-79f8fd7f896b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:52.932374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22468c65-8e5a-46d4-91e8-79f8fd7f896b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:52.972473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:52.973284 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:52.973566 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:52.973841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:52.988395 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:52.996135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:52.996995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:10:52.997839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 76/151] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:53.004553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b886-3a71-424f-8e41-39ebcf906593 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:53.109936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:53.139569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373b886-3a71-424f-8e41-39ebcf906593 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:53.176709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:53.177399 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:53.177679 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:53.177961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:53.178712 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:53.179016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:53.180474 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:53.190037 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 76/152] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:53.195575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:53.260693 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:53.352664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c707a-dd95-4d3d-8660-b143a84a740c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:53.396649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:53.397540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:53.397822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:53.398097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:53.404127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:53.405854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:53.407989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 77/153] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:53 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:53.413897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:53.559517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1b2e5-0e32-4da4-821b-3b62183033c8 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:53.603385 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014f5aa-be62-42eb-8bbf-52fd87330520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:53.604076 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014f5aa-be62-42eb-8bbf-52fd87330520 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:53.604360 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014f5aa-be62-42eb-8bbf-52fd87330520 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:53.604646 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014f5aa-be62-42eb-8bbf-52fd87330520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:53.609188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:53.680536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014f5aa-be62-42eb-8bbf-52fd87330520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:53.682227 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014f5aa-be62-42eb-8bbf-52fd87330520 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:53.788208 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 77/154] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:53.793951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:53.821792 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72d2a-e6bc-4f39-9f53-77dc1e9ca786 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:53.821972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72d2a-e6bc-4f39-9f53-77dc1e9ca786 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:53.822169 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72d2a-e6bc-4f39-9f53-77dc1e9ca786 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:53.826692 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 78/155] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:53.832725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43cb4-82b3-4091-86e7-8cffda7b2a48 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:53.833010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43cb4-82b3-4091-86e7-8cffda7b2a48 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:53.833287 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43cb4-82b3-4091-86e7-8cffda7b2a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:53.855708 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-8dc43cb4-82b3-4091-86e7-8cffda7b2a48 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:53.856896 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-8dc43cb4-82b3-4091-86e7-8cffda7b2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:53.917383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:53.984637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:53.988050 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac300ab7-8cb0-4b88-a304-c0335f4a816e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:53.989216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 79/156] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:10:53.990752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2422ddc-720d-4e4a-9472-00d52ad9e095 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:53.991883 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2422ddc-720d-4e4a-9472-00d52ad9e095 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:53.991883 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2422ddc-720d-4e4a-9472-00d52ad9e095 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:53.993482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 80/157] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:54.002131 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c17b1b-e8ec-4445-80d6-955d94d333c2 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:54.002840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c17b1b-e8ec-4445-80d6-955d94d333c2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:54.003129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c17b1b-e8ec-4445-80d6-955d94d333c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:54.035842 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-81c17b1b-e8ec-4445-80d6-955d94d333c2 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:54.039301 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-81c17b1b-e8ec-4445-80d6-955d94d333c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:54.061835 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:54.062855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:54.063066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:54.063506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:54.065848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:54.068368 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:54.070141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 78/158] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:53 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:54.070907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:54.179079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 81/159] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:54.180192 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3b257-f133-40b5-aac7-ba39d09e39ff None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:54.180482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3b257-f133-40b5-aac7-ba39d09e39ff None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:54.180761 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3b257-f133-40b5-aac7-ba39d09e39ff None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:54.182173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 82/160] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:54.182694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3b257-f133-40b5-aac7-ba39d09e39ff None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:54.349457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce33f03-fb98-4f0e-9301-e3b7bf4e4d14 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:54.366086 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:54.392192 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3b257-f133-40b5-aac7-ba39d09e39ff None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:54.434007 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a7c58-270a-4347-9f35-fe29aeaab744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:54.435497 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7c58-270a-4347-9f35-fe29aeaab744 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:54.436109 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7c58-270a-4347-9f35-fe29aeaab744 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:54.436595 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a7c58-270a-4347-9f35-fe29aeaab744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:54.471594 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a7c58-270a-4347-9f35-fe29aeaab744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:54.480657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:54.480857 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:54.481279 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:54.487415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:54.487415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=89587fceb82a48d69851e13e14ad9293) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:54.487415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:54.487415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a03a7c58-270a-4347-9f35-fe29aeaab744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:54.492105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:54.492966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:54.493728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:10:54.496561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 79/161] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:54.498150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c2c7-aeec-42ca-877f-3d0a94e00822 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:54.498697 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c2c7-aeec-42ca-877f-3d0a94e00822 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:54.499319 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130c2c7-aeec-42ca-877f-3d0a94e00822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:54.499698 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 83/162] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:54 2022] GET /identity/v3/role_assignments?user.id=89587fceb82a48d69851e13e14ad9293&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:54.500398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:54.536440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a130c2c7-aeec-42ca-877f-3d0a94e00822 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:54.538188 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a130c2c7-aeec-42ca-877f-3d0a94e00822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:54.598503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:54.688481 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bc918-8688-4aff-a4f6-1413f30d2309 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:54.718485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 80/163] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:54.719743 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c2c7-aeec-42ca-877f-3d0a94e00822 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:54.738669 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:54.739517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:54.739802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:54.740075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:54.761634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:54.784525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:54.785584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:54.786528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 84/164] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:10:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:54.787157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:54.828153 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:54.933718 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130c2c7-aeec-42ca-877f-3d0a94e00822 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:54.977634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768b1e1-b04e-4166-9e2a-00d385831b45 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.030171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533f805-9ef0-46f1-9821-2fab16afd9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.031298 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f805-9ef0-46f1-9821-2fab16afd9a3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.031609 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f805-9ef0-46f1-9821-2fab16afd9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.032027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f805-9ef0-46f1-9821-2fab16afd9a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.032362 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.033241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.033690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.034210 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.035441 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:55.036040 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:55.038651 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:55.057962 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 81/165] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:55.059239 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.083363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533f805-9ef0-46f1-9821-2fab16afd9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:55.096996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-b533f805-9ef0-46f1-9821-2fab16afd9a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:55.098729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:55.100255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:55.101045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 85/166] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:55.103095 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b0448-d7ea-4ef1-9180-e0fe1c1f70d4 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.103877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b0448-d7ea-4ef1-9180-e0fe1c1f70d4 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.103877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b0448-d7ea-4ef1-9180-e0fe1c1f70d4 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.106029 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 86/167] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:55.116367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b0448-d7ea-4ef1-9180-e0fe1c1f70d4 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.196194 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a2c16-d99f-404b-b702-6259982648d1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.238266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.239257 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.239749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.240200 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.241238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:55.241727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:55.243340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:55.252843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 82/168] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:55.253943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.297873 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:55.313454 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b0448-d7ea-4ef1-9180-e0fe1c1f70d4 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.343620 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:55.357807 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f711157-e18e-430d-89f7-89bee30c3d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.358879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f711157-e18e-430d-89f7-89bee30c3d69 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.359179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f711157-e18e-430d-89f7-89bee30c3d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.359505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f711157-e18e-430d-89f7-89bee30c3d69 None admin] PATH_INFO: `/v3/users/f728f0a5a3434bf7868adf527331fd5c` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.362315 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f711157-e18e-430d-89f7-89bee30c3d69 None admin] RBAC: Authorizing `identity:get_user(user_id=f728f0a5a3434bf7868adf527331fd5c)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:55.363431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f711157-e18e-430d-89f7-89bee30c3d69 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:55.365542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 87/169] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/users/f728f0a5a3434bf7868adf527331fd5c => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:55.366961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a43c4-b520-4bba-9f82-397c07f44ed9 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.367251 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a43c4-b520-4bba-9f82-397c07f44ed9 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.367550 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a43c4-b520-4bba-9f82-397c07f44ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.369128 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a1cc-38b8-436b-a326-1617cc47869f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.386636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-301a43c4-b520-4bba-9f82-397c07f44ed9 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:55.388052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-301a43c4-b520-4bba-9f82-397c07f44ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:55.406214 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39fb7d-e61c-4307-88c5-e38247eafdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.407212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39fb7d-e61c-4307-88c5-e38247eafdf9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.407696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39fb7d-e61c-4307-88c5-e38247eafdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.408153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39fb7d-e61c-4307-88c5-e38247eafdf9 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.409171 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39fb7d-e61c-4307-88c5-e38247eafdf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:55.409662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39fb7d-e61c-4307-88c5-e38247eafdf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:55.411246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39fb7d-e61c-4307-88c5-e38247eafdf9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:55.420529 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 83/170] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:55.422207 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74466-b93c-406f-a923-02cf5cdc455c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.422749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74466-b93c-406f-a923-02cf5cdc455c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.423233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74466-b93c-406f-a923-02cf5cdc455c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.424714 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 84/171] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:55.425623 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f74466-b93c-406f-a923-02cf5cdc455c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.472489 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 88/172] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:55.473603 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a43c4-b520-4bba-9f82-397c07f44ed9 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.536246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f74466-b93c-406f-a923-02cf5cdc455c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.559794 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:55.573342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.574533 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.575004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.575321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.576600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:55.578104 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:55.583309 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 85/173] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:55.583309 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.590945 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a43c4-b520-4bba-9f82-397c07f44ed9 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.595351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:55.628239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.629072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.629483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.630129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.685344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38eb62-3661-4467-a8dd-5da424fb9e45 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.702079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:55.703596 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:55.720874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0cc54-4af6-432c-b64b-866e8f7fc244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.721757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0cc54-4af6-432c-b64b-866e8f7fc244 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.722039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0cc54-4af6-432c-b64b-866e8f7fc244 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.722315 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0cc54-4af6-432c-b64b-866e8f7fc244 None admin] PATH_INFO: `/v3/users/89587fceb82a48d69851e13e14ad9293` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.723558 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0cc54-4af6-432c-b64b-866e8f7fc244 None admin] RBAC: Authorizing `identity:get_user(user_id=89587fceb82a48d69851e13e14ad9293)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:55.725017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0cc54-4af6-432c-b64b-866e8f7fc244 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:55.726665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 86/174] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/users/89587fceb82a48d69851e13e14ad9293 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:55.727831 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e59a37-3df5-4fb7-8281-443d2fb2400c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.728119 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e59a37-3df5-4fb7-8281-443d2fb2400c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.728399 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e59a37-3df5-4fb7-8281-443d2fb2400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.744796 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c8e59a37-3df5-4fb7-8281-443d2fb2400c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:55.745999 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c8e59a37-3df5-4fb7-8281-443d2fb2400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:55.780462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:55.803146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 89/175] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:55.808262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.828807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 87/176] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:55.828807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8014b-15c0-4b9f-b6ff-0857fb56909a None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.828807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8014b-15c0-4b9f-b6ff-0857fb56909a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.828807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8014b-15c0-4b9f-b6ff-0857fb56909a None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.828807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 88/177] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:55.828807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8014b-15c0-4b9f-b6ff-0857fb56909a None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:55.828807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:55.911961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1852d-e06d-4082-81a9-357a3d8c4eaf None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.926463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8014b-15c0-4b9f-b6ff-0857fb56909a None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:55.947065 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef4201-9bf2-4d31-b8a2-b1196b6dc050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.947906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4201-9bf2-4d31-b8a2-b1196b6dc050 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.948185 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4201-9bf2-4d31-b8a2-b1196b6dc050 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.948454 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef4201-9bf2-4d31-b8a2-b1196b6dc050 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.958688 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef4201-9bf2-4d31-b8a2-b1196b6dc050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:55.960790 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:55.961461 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.961759 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.962026 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-aaef4201-9bf2-4d31-b8a2-b1196b6dc050 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:55.966196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:55.967121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:55.968252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 90/178] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:55.969150 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f423b4-1a0d-41c5-aec5-772c51e22624 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:55.969432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f423b4-1a0d-41c5-aec5-772c51e22624 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:55.969705 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f423b4-1a0d-41c5-aec5-772c51e22624 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:55.970958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 91/179] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:10:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:10:55.975199 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f423b4-1a0d-41c5-aec5-772c51e22624 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.012703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.035400 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.036920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.047956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.076476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f423b4-1a0d-41c5-aec5-772c51e22624 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.113893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.114544 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.114824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.115104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.137760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 89/180] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:56.138873 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.188116 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.189964 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.227949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.235428 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ba68c-a946-470f-901b-883ec8dcbe85 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.245777 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.268924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d19d7-c8df-420c-bace-83a8a28a64f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.269792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d19d7-c8df-420c-bace-83a8a28a64f0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.270074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d19d7-c8df-420c-bace-83a8a28a64f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.270355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d19d7-c8df-420c-bace-83a8a28a64f0 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.271559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d19d7-c8df-420c-bace-83a8a28a64f0 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.273049 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d19d7-c8df-420c-bace-83a8a28a64f0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.274715 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 90/181] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:56.275860 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4336096-f82e-40a2-b071-106283fe7985 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.276141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4336096-f82e-40a2-b071-106283fe7985 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.276414 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4336096-f82e-40a2-b071-106283fe7985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.292051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c4336096-f82e-40a2-b071-106283fe7985 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:56.292362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 92/182] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:56.293219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.296274 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c4336096-f82e-40a2-b071-106283fe7985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:56.364156 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 91/183] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:56.365028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4336096-f82e-40a2-b071-106283fe7985 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.401474 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdcc7e-acf5-43bf-b030-3782c586627c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.436262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8107ee-50c0-4770-a955-c731a867b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.437069 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8107ee-50c0-4770-a955-c731a867b44f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.437345 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8107ee-50c0-4770-a955-c731a867b44f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.437610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8107ee-50c0-4770-a955-c731a867b44f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.444730 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.448641 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8107ee-50c0-4770-a955-c731a867b44f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-bf8107ee-50c0-4770-a955-c731a867b44f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:56.456897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:56.457811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:56.458597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 93/184] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:56.459476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62079dca-bfea-4dd2-9df6-ac2eec977e8b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.459558 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62079dca-bfea-4dd2-9df6-ac2eec977e8b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.459822 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62079dca-bfea-4dd2-9df6-ac2eec977e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.474952 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4336096-f82e-40a2-b071-106283fe7985 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.475939 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-62079dca-bfea-4dd2-9df6-ac2eec977e8b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:10:56.477115 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-62079dca-bfea-4dd2-9df6-ac2eec977e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:10:56.484489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.509740 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.510427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.510714 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.510994 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.511792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:56.512110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.513699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.521940 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 92/185] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:56.522738 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.559791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 94/186] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:10:56.571543 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62079dca-bfea-4dd2-9df6-ac2eec977e8b None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.629662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7826a9-1b50-426b-a9a1-8c9a849a406b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.662705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.663455 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62079dca-bfea-4dd2-9df6-ac2eec977e8b None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.663598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.663886 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.664163 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.665366 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.666832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.668565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 93/187] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:56.669332 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.690779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.699624 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.700294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.700569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.700874 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.701715 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=f728f0a5a3434bf7868adf527331fd5c) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:56.702021 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.703505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.710034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.710321 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 95/188] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/role_assignments?user.id=f728f0a5a3434bf7868adf527331fd5c&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=079434fe84194c03ae64e10d61e222e6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:56.711574 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.777772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53368c6c-671a-4e0f-99a3-34f4f7097ae5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.824392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.825386 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.825938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.826569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] PATH_INFO: `/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.827920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] RBAC: Authorizing `identity:get_project(project_id=fc9da971e3ed44cb8cb4bbab81fdf726)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.829412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.831382 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 94/189] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/projects/fc9da971e3ed44cb8cb4bbab81fdf726 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:56.832291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.838171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb9f91-1b0a-456c-936a-82cd5f144b5c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.876317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.877175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.877454 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.877724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.890484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:10:56.899011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:10:56.899966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:10:56.900746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 96/190] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:10:56.905913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:56.947221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd25c8-eaaa-44ca-a7c0-ce8e6f536918 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:56.957638 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.969956 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:56.987424 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:56.988104 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:56.988391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:56.988672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:56.989438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:56.989750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:56.991146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:56.999833 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 95/191] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.000378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.017314 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70f90a-c582-4b64-9056-579b6a019cea None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.049742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.050639 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.050953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.051231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] PATH_INFO: `/v3/users/66a89a437e9b4c14ab78f74369ea8e86` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.065941 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] RBAC: Authorizing `identity:get_user(user_id=66a89a437e9b4c14ab78f74369ea8e86)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.067480 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.069181 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 97/192] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/users/66a89a437e9b4c14ab78f74369ea8e86 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.069955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.097538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17ebe7-fe0a-44a2-9446-36ede831f8c7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.130802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.131640 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.131919 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.132196 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.133347 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.134827 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.136474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 96/193] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:10:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.141635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.173663 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627279a-7ec9-45e8-bb5a-5282776fbfd7 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.177335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.184488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.207989 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.208624 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.208906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.209180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.210028 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] RBAC: Adding query filter params (role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=89587fceb82a48d69851e13e14ad9293) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:57.210334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.211828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.218384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 98/194] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/role_assignments?user.id=89587fceb82a48d69851e13e14ad9293&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=81307e0920ce427d9422f90d0da01275 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.219195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.246439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523edced-9f7d-4c37-a08f-67be65210881 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.285850 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.286548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.286830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.287103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.288066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=fc9da971e3ed44cb8cb4bbab81fdf726, user.id=89587fceb82a48d69851e13e14ad9293) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:57.288334 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.289817 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.307322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 97/195] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/role_assignments?user.id=89587fceb82a48d69851e13e14ad9293&scope.project.id=fc9da971e3ed44cb8cb4bbab81fdf726&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.307322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.351593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a9b41-fdba-4ad0-8a72-3358aca71e6e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.403601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.404625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.404991 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.405914 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.406910 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:57.407377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.409044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.421156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 99/196] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.422056 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.450151 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.454346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f27bb-e024-446a-be7b-69285bd295b6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.465408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.503656 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.505010 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.505361 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.505744 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] PATH_INFO: `/v3/users/10ad18e99b01476c9612271ad51e45f8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.507147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] RBAC: Authorizing `identity:get_user(user_id=10ad18e99b01476c9612271ad51e45f8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.508795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.510754 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 98/197] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/users/10ad18e99b01476c9612271ad51e45f8 => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.511606 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.556796 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920bd90-f457-413f-b687-626f47ac1de7 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.595057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.595940 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.596230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.596509 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.630263 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7627d-8e49-4b46-a026-12131545889d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.663405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.664012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.664110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.664290 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.664560 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.665262 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.665585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.666689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.687909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 99/198] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:10:57 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:10:57.687909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.703635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.717601 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.782684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 100/199] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:57.787790 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.814897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe7247-a2e9-4a8d-a822-aebc3199f1f8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.856004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.857296 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.857576 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.858034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] PATH_INFO: `/v3/users/66a89a437e9b4c14ab78f74369ea8e86` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.859360 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] RBAC: Authorizing `identity:get_user(user_id=66a89a437e9b4c14ab78f74369ea8e86)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:57.860851 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:57.867114 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 100/200] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/users/66a89a437e9b4c14ab78f74369ea8e86 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:57.867114 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:57.905153 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746eba7-155e-49bd-b25d-5d0da975dbd6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:57.949330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:57.950025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:57.950311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:57.950917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:57.961241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.983528 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:57.999172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa447471-b4e8-4c2c-95a8-bbd4244b1d98 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:58.040299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:58.041186 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:58.041488 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:58.041753 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:58.042738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.042966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.044500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.044955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.046293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 101/201] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:58.047158 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:58.160644 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120f0c0-af74-4bdf-8cde-b15cba26e427 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:58.170180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 101/202] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:58.171024 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:58.199142 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:58.200280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:58.201162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:58.201636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:58.220406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:58.238881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:58.285159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.287054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.305674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79acfe92-db4f-4b35-ad86-6a1bd464b2aa None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:58.354333 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:58.355014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:58.355334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:58.355627 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:58.356475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=66a89a437e9b4c14ab78f74369ea8e86) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:58.356791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.358404 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.367484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 102/203] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:58 2022] GET /identity/v3/role_assignments?user.id=66a89a437e9b4c14ab78f74369ea8e86&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=079434fe84194c03ae64e10d61e222e6 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:58.368653 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:58.431066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 102/204] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:10:58.433144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:58.513868 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:58.604670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:58.606828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8a3df-a8bf-46f8-b7a4-651d94ce69aa None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:58.608906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f64960-e6b1-4e54-96f6-be65f42c0b20 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:58.654686 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:58.656607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:58.657162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:58.658450 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:58.658554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:58.658925 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:58.659209 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:58.660168 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:58.660653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.661976 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.662952 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.663318 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.664933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 103/205] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:58 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:10:58.665890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 103/206] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:10:58 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:58.674214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:58.680518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:10:58.841511 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e48aa-1d9e-40f6-ad6a-79d9c7d3c4a8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:58.870587 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:10:58.881272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc24a8-5724-49bc-bda7-5974b72bc614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:58.882152 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc24a8-5724-49bc-bda7-5974b72bc614 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:58.882610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc24a8-5724-49bc-bda7-5974b72bc614 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:58.883033 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc24a8-5724-49bc-bda7-5974b72bc614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:58.884209 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc24a8-5724-49bc-bda7-5974b72bc614 None admin] RBAC: Adding query filter params (role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=66a89a437e9b4c14ab78f74369ea8e86) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:58.884702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc24a8-5724-49bc-bda7-5974b72bc614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.886308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc24a8-5724-49bc-bda7-5974b72bc614 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.892788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 104/207] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:58 2022] GET /identity/v3/role_assignments?user.id=66a89a437e9b4c14ab78f74369ea8e86&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=81307e0920ce427d9422f90d0da01275 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:10:58.917000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631ffa2-d5a2-4808-9856-3b68f8876321 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:10:58.958042 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d764ae-4269-4129-9cb4-4365cc0da82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:10:58.958980 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d764ae-4269-4129-9cb4-4365cc0da82a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:10:58.959444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d764ae-4269-4129-9cb4-4365cc0da82a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:10:58.959864 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d764ae-4269-4129-9cb4-4365cc0da82a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:10:58.960855 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d764ae-4269-4129-9cb4-4365cc0da82a None admin] RBAC: Adding query filter params (role.id=664d5ea3869d4279ad66bd535835eecf, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74, user.id=10ad18e99b01476c9612271ad51e45f8) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:10:58.961346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d764ae-4269-4129-9cb4-4365cc0da82a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:10:58.962955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d764ae-4269-4129-9cb4-4365cc0da82a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:10:58.971039 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 104/208] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:10:58 2022] GET /identity/v3/role_assignments?user.id=10ad18e99b01476c9612271ad51e45f8&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=664d5ea3869d4279ad66bd535835eecf => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:00.135349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7e2e-c16f-4264-9819-d59e09a68e64 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.135867 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7e2e-c16f-4264-9819-d59e09a68e64 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.135867 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7e2e-c16f-4264-9819-d59e09a68e64 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.137443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 105/209] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:00.143235 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a824c-dd99-439f-a614-4006e0ce3b72 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.143755 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a824c-dd99-439f-a614-4006e0ce3b72 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.143839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a824c-dd99-439f-a614-4006e0ce3b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.163466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-532a824c-dd99-439f-a614-4006e0ce3b72 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:00.164875 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-532a824c-dd99-439f-a614-4006e0ce3b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:00.196322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:00.239798 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 105/210] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:00.265358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed7e2e-c16f-4264-9819-d59e09a68e64 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:00.369425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5dbbf-76c5-4927-90d0-9f654da1060a None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.369786 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5dbbf-76c5-4927-90d0-9f654da1060a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.370055 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5dbbf-76c5-4927-90d0-9f654da1060a None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.371779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 106/211] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:00.375652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed7e2e-c16f-4264-9819-d59e09a68e64 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:00.378582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80e1ff-6151-4504-b6bc-f8f1d2844a10 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.378939 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80e1ff-6151-4504-b6bc-f8f1d2844a10 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.379222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80e1ff-6151-4504-b6bc-f8f1d2844a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.406562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-bb80e1ff-6151-4504-b6bc-f8f1d2844a10 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:00.408493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-bb80e1ff-6151-4504-b6bc-f8f1d2844a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:00.414661 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:00.415515 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.415811 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.416093 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.428833 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:00.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:00.439981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:00.440770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 106/212] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:00.446345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:00.504008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:00.505248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 107/213] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:00.531400 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80e1ff-6151-4504-b6bc-f8f1d2844a10 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:00.561090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a88111-fba8-4aff-a8b5-283c7233fb3d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:00.597417 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:00.598134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.598422 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.598699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.599551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:00.599869 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:00.601356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:00.610474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 107/214] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:00.615910 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:00.631023 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:00.641144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80e1ff-6151-4504-b6bc-f8f1d2844a10 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:00.678388 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:00.679822 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.680327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.680827 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.682193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:00.683898 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:00.690629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 108/215] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:00.691751 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:00.723557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5296d9-f7f4-4fc2-8f0a-7d53e9b75122 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:00.739340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:00.765538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808e777-1056-461d-9709-202e427abd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:00.766706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808e777-1056-461d-9709-202e427abd16 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.767230 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808e777-1056-461d-9709-202e427abd16 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.767742 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808e777-1056-461d-9709-202e427abd16 None admin] PATH_INFO: `/v3/users/de42ea74a27841abbf2efc030c3fa8e8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.783186 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808e777-1056-461d-9709-202e427abd16 None admin] RBAC: Authorizing `identity:get_user(user_id=de42ea74a27841abbf2efc030c3fa8e8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:00.785100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808e777-1056-461d-9709-202e427abd16 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:00.787120 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 108/216] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:00 2022] GET /identity/v3/users/de42ea74a27841abbf2efc030c3fa8e8 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:00.792917 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808e777-1056-461d-9709-202e427abd16 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:00.804225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78298281-df9e-4a42-9929-388f48b7ed48 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:00.840959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f05b14-02f6-4abe-b5e4-0760463909b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:00.841681 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05b14-02f6-4abe-b5e4-0760463909b2 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.842015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05b14-02f6-4abe-b5e4-0760463909b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.842296 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f05b14-02f6-4abe-b5e4-0760463909b2 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.843028 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f05b14-02f6-4abe-b5e4-0760463909b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:00.844518 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f05b14-02f6-4abe-b5e4-0760463909b2 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:00.872174 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 109/217] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:11:00 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:00.914830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808e777-1056-461d-9709-202e427abd16 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:00.951303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df4b3-7551-4176-af36-87c47fac92e5 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.951643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df4b3-7551-4176-af36-87c47fac92e5 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.951884 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df4b3-7551-4176-af36-87c47fac92e5 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.953645 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 110/218] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:00.959519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:00.959985 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ca64-2ac4-45bd-aa4d-ce2a753ae13e None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.960193 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:00.960543 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.960823 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.961048 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ca64-2ac4-45bd-aa4d-ce2a753ae13e None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:00.961518 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ca64-2ac4-45bd-aa4d-ce2a753ae13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:00.979061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-c2c7ca64-2ac4-45bd-aa4d-ce2a753ae13e None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:00.980665 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-c2c7ca64-2ac4-45bd-aa4d-ce2a753ae13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:00.993837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:01.020955 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:01.057781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:01.059149 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:01.071519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 111/219] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:01.091760 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7ca64-2ac4-45bd-aa4d-ce2a753ae13e None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:01.178003 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 109/220] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:01.184152 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:01.232436 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7ca64-2ac4-45bd-aa4d-ce2a753ae13e None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:01.281733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:01.282567 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:01.282846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:01.283121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:01.286551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:01.299965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:01.307800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:01.308660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:01.309426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 112/221] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:01.318410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:01.329842 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:01.334268 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7ec3f-577f-4b10-ade7-d1426d3516b6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:01.373968 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:01.375180 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:01.375652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:01.376124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:01.377487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:01.379119 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:01.381063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 110/222] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:01 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:01.389539 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:01.445239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f0882-d28a-4e12-a6d3-5d2412e32be6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:01.483125 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ca7b8-c835-4d54-9e2f-6cc69cf7ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:01.484624 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca7b8-c835-4d54-9e2f-6cc69cf7ae62 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:01.484921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca7b8-c835-4d54-9e2f-6cc69cf7ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:01.485204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ca7b8-c835-4d54-9e2f-6cc69cf7ae62 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:01.485979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca7b8-c835-4d54-9e2f-6cc69cf7ae62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:01.486290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca7b8-c835-4d54-9e2f-6cc69cf7ae62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:01.487764 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ca7b8-c835-4d54-9e2f-6cc69cf7ae62 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:01.501115 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 113/223] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:01.502808 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678eba-7483-4afb-bc88-16e9ad59eaae None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:01.503106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678eba-7483-4afb-bc88-16e9ad59eaae None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:01.503414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678eba-7483-4afb-bc88-16e9ad59eaae None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:01.505335 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 114/224] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:01.509871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f678eba-7483-4afb-bc88-16e9ad59eaae None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:01.523086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca64c9-5f47-4290-b8f7-7bd14d1284b9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:01.568500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02806f6f-6ed8-4206-9bc1-b3f932e62986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:01.569584 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02806f6f-6ed8-4206-9bc1-b3f932e62986 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:01.569880 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02806f6f-6ed8-4206-9bc1-b3f932e62986 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:01.570163 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02806f6f-6ed8-4206-9bc1-b3f932e62986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:01.571325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02806f6f-6ed8-4206-9bc1-b3f932e62986 None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=de42ea74a27841abbf2efc030c3fa8e8) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:01.571650 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02806f6f-6ed8-4206-9bc1-b3f932e62986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:01.573867 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02806f6f-6ed8-4206-9bc1-b3f932e62986 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:01.581940 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 111/225] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:01 2022] GET /identity/v3/role_assignments?user.id=de42ea74a27841abbf2efc030c3fa8e8&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:01.583405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71562b80-9195-4ad9-8601-26014370c1a7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:01.583700 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71562b80-9195-4ad9-8601-26014370c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:01.583979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71562b80-9195-4ad9-8601-26014370c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:01.590484 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:01.607707 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-71562b80-9195-4ad9-8601-26014370c1a7 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:01.609622 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-71562b80-9195-4ad9-8601-26014370c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:01.619943 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:01.690220 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f678eba-7483-4afb-bc88-16e9ad59eaae None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:01.747360 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:01.748247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:01.748538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:01.751299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] PATH_INFO: `/v3/users/66a89a437e9b4c14ab78f74369ea8e86` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:01.751299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] RBAC: Authorizing `identity:get_user(user_id=66a89a437e9b4c14ab78f74369ea8e86)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:01.751867 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:01.753966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 115/226] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:01 2022] GET /identity/v3/users/66a89a437e9b4c14ab78f74369ea8e86 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:01.760631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:01.781049 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 112/227] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:01.828483 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71562b80-9195-4ad9-8601-26014370c1a7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:01.943503 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9812afb-c6c5-46b8-9836-b73438dcbc47 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:02.003837 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71562b80-9195-4ad9-8601-26014370c1a7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:02.018430 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:02.019353 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:02.019640 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:02.019921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:02.021128 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:02.022608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:02.024686 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 116/228] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:01 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:02.030560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:02.039061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:02.076014 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:02.076854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:02.077138 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:02.077419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:02.087596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:02.098170 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:02.107371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:02.108246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:02.109012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 113/229] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:02.116103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:02.216856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26f99e-c61e-46d6-a69f-000e40658972 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:02.251179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:02.251902 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:02.252187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:02.252463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:02.253278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:02.253588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:02.255098 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:02.264032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 114/230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:02.271013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:02.332685 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:02.341700 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78688885-6af1-4bdf-92fe-40c9f59dc71b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:02.375757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4055b17-5809-4bea-b723-8b1adcbcf52e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:02.410564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:02.411500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:02.411785 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:02.412063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] PATH_INFO: `/v3/users/66a89a437e9b4c14ab78f74369ea8e86` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:02.417045 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] RBAC: Authorizing `identity:get_user(user_id=66a89a437e9b4c14ab78f74369ea8e86)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:02.418517 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:02.420269 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 115/231] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:02 2022] GET /identity/v3/users/66a89a437e9b4c14ab78f74369ea8e86 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:02.427110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:02.448285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:02.449256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:02.451771 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:02.452076 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/66a89a437e9b4c14ab78f74369ea8e86/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:02.455793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78f5cbfe8534463b2874b2b38757dd8, user_id=66a89a437e9b4c14ab78f74369ea8e86, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:02.459635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:02.490800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 117/232] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:02 2022] PUT /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/66a89a437e9b4c14ab78f74369ea8e86/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:02.569121 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fee19a-3cc6-4e45-aadb-be88ab895961 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:02.594504 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:02.605389 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa6b9d-d6f6-478b-9e0c-3bb391dbb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:02.606930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6b9d-d6f6-478b-9e0c-3bb391dbb9ab None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:02.607600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6b9d-d6f6-478b-9e0c-3bb391dbb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:02.608295 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6b9d-d6f6-478b-9e0c-3bb391dbb9ab None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:02.609679 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6b9d-d6f6-478b-9e0c-3bb391dbb9ab None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:02.611237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6b9d-d6f6-478b-9e0c-3bb391dbb9ab None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:02.613024 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 116/233] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:02 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:02.619066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:02.697184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:02.750146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e399b-a537-4392-9ba4-02d229657be0 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:02.785588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90657ceb-4cf8-4257-9c5c-84c2f861094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:02.786492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90657ceb-4cf8-4257-9c5c-84c2f861094b None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:02.786827 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90657ceb-4cf8-4257-9c5c-84c2f861094b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:02.787103 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90657ceb-4cf8-4257-9c5c-84c2f861094b None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/66a89a437e9b4c14ab78f74369ea8e86/roles/81307e0920ce427d9422f90d0da01275` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:02.789460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90657ceb-4cf8-4257-9c5c-84c2f861094b None admin] RBAC: Authorizing `identity:create_grant(project_id=b78f5cbfe8534463b2874b2b38757dd8, user_id=66a89a437e9b4c14ab78f74369ea8e86, role_id=81307e0920ce427d9422f90d0da01275)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:02.790916 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90657ceb-4cf8-4257-9c5c-84c2f861094b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:02.818950 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 118/234] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:02 2022] PUT /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/66a89a437e9b4c14ab78f74369ea8e86/roles/81307e0920ce427d9422f90d0da01275 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:03.791033 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3483522-2ad1-4351-966f-074dfe7a13b7 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:03.791622 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3483522-2ad1-4351-966f-074dfe7a13b7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:03.791622 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3483522-2ad1-4351-966f-074dfe7a13b7 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:03.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 117/235] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:03.812364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197b99-24b3-49ac-a8ab-307c3ef923f8 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:03.812892 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197b99-24b3-49ac-a8ab-307c3ef923f8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:03.812892 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9197b99-24b3-49ac-a8ab-307c3ef923f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:03.834422 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-c9197b99-24b3-49ac-a8ab-307c3ef923f8 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:03.835707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-c9197b99-24b3-49ac-a8ab-307c3ef923f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:03.925416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 119/236] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:03.962996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3483522-2ad1-4351-966f-074dfe7a13b7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.070358 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac12d6-13e5-4973-bb62-69f9acab1aeb None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.070673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac12d6-13e5-4973-bb62-69f9acab1aeb None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.070838 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac12d6-13e5-4973-bb62-69f9acab1aeb None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.072512 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 120/237] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:04.078617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e399b-b8a5-4003-9278-94aec4398234 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.078902 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e399b-b8a5-4003-9278-94aec4398234 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.079181 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e399b-b8a5-4003-9278-94aec4398234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.092147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3483522-2ad1-4351-966f-074dfe7a13b7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.096932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-622e399b-b8a5-4003-9278-94aec4398234 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:04.098113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-622e399b-b8a5-4003-9278-94aec4398234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:04.133597 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.134944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.135223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.135991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.159535 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:04.167726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:04.168581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:04.169821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 118/238] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:04.175084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:04.180372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.197478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 121/239] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:04.198834 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e2cf-7ae9-47ee-94b0-cc7b073daca1 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.199124 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e2cf-7ae9-47ee-94b0-cc7b073daca1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.203477 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e2cf-7ae9-47ee-94b0-cc7b073daca1 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.205102 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 122/240] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:04.210140 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beb6d6-8598-475a-b3ea-40769f30bbfd None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.210429 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beb6d6-8598-475a-b3ea-40769f30bbfd None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.210707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2beb6d6-8598-475a-b3ea-40769f30bbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.228670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-c2beb6d6-8598-475a-b3ea-40769f30bbfd None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:04.229916 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-c2beb6d6-8598-475a-b3ea-40769f30bbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:04.241017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:04.291494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265448b7-0b33-4140-b429-e5ce76d9b505 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.304937 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 123/241] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:04.305952 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beb6d6-8598-475a-b3ea-40769f30bbfd None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.337348 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.337945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.338228 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.338503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.339249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:04.339595 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:04.340994 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:04.350425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 119/242] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:04.355871 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.432551 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2beb6d6-8598-475a-b3ea-40769f30bbfd None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.456396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:04.459705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51f2c-a533-402b-ab67-c558ee4cb730 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.476107 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:04.481650 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.482819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.484301 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.484758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.486621 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:04.489078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:04.491955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 124/243] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:04.493478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.499894 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.500717 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.501006 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.501283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.512170 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:04.520231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:04.521123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:04.521913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:04.526322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 120/244] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:04.527149 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.629616 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a67df-31a9-466c-b743-fc68e7987b48 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.636276 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e764b-9668-4833-b3c8-6e465f819295 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.672824 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.673515 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.673786 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.674063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.674781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:04.676397 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:04.679113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.680242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.680709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.681184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] PATH_INFO: `/v3/users/9f8cc9cf1454405f9cafb766c769a639` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.698973 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] RBAC: Authorizing `identity:get_user(user_id=9f8cc9cf1454405f9cafb766c769a639)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:04.701652 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:04.704256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 125/245] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:04 2022] GET /identity/v3/users/9f8cc9cf1454405f9cafb766c769a639 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:04.705311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.708971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 121/246] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:11:04 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:04.712118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:04.780875 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:04.794730 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:04.916407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d24ea4-04b7-4329-8d07-3b9d45d01794 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.924184 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35799d8-58a4-4f03-b2b9-e24de0e97245 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:04.969110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.970644 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.971128 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.971576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.972538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:04.973169 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:04.975620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:04.978400 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:04.979335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:04.979800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:04.980298 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:04.985864 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 126/247] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:04.993640 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:05.077446 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:05.079342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:05.119911 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:05.125361 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4668b6-d31e-4229-8836-afcd32794572 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:05.143988 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:05.180721 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:05.185110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.185607 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.186052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] PATH_INFO: `/v3/users/de42ea74a27841abbf2efc030c3fa8e8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.187682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] RBAC: Authorizing `identity:get_user(user_id=de42ea74a27841abbf2efc030c3fa8e8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:05.189827 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:05.192311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 127/248] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:04 2022] GET /identity/v3/users/de42ea74a27841abbf2efc030c3fa8e8 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:05.200334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:05.214810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 122/249] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:05.222342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:05.334177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e3afb-1b56-4c7f-a137-8bf683d4132d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:05.349792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefa3f5-5b25-4900-93dc-befcc804d41c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:05.373635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715963-f405-4795-a9ee-bf5d143088c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:05.374590 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715963-f405-4795-a9ee-bf5d143088c3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.374878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715963-f405-4795-a9ee-bf5d143088c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.375208 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715963-f405-4795-a9ee-bf5d143088c3 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.376474 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715963-f405-4795-a9ee-bf5d143088c3 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:05.377960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715963-f405-4795-a9ee-bf5d143088c3 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:05.380128 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 128/250] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:05 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:05.381364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de2d8-d98c-406b-a9c8-4924b7530a72 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.381653 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de2d8-d98c-406b-a9c8-4924b7530a72 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.381938 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537de2d8-d98c-406b-a9c8-4924b7530a72 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.383201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 129/251] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:05.385038 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:05.389548 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de2d8-d98c-406b-a9c8-4924b7530a72 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:05.394526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d26cc1-534b-451b-83f3-13f880ab8b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:05.395644 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d26cc1-534b-451b-83f3-13f880ab8b1b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.396103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d26cc1-534b-451b-83f3-13f880ab8b1b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.396528 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d26cc1-534b-451b-83f3-13f880ab8b1b None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.397943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d26cc1-534b-451b-83f3-13f880ab8b1b None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:05.400178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d26cc1-534b-451b-83f3-13f880ab8b1b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:05.402538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 123/252] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:05 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:05.404514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090bda-d9f8-4773-b8f4-641540da0707 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.404991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090bda-d9f8-4773-b8f4-641540da0707 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.405438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090bda-d9f8-4773-b8f4-641540da0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.427984 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-6f090bda-d9f8-4773-b8f4-641540da0707 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:05.429183 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6f090bda-d9f8-4773-b8f4-641540da0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:05.452510 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:05.537505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537de2d8-d98c-406b-a9c8-4924b7530a72 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:05.537977 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 124/253] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:05.539178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f090bda-d9f8-4773-b8f4-641540da0707 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:05.577701 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:05.578904 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.579190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.579500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/de42ea74a27841abbf2efc030c3fa8e8/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.582297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] RBAC: Authorizing `identity:create_grant(project_id=b78f5cbfe8534463b2874b2b38757dd8, user_id=de42ea74a27841abbf2efc030c3fa8e8, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:05.583850 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:05.615322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 130/254] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:05 2022] PUT /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/de42ea74a27841abbf2efc030c3fa8e8/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:11:05.616089 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:05.669634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f090bda-d9f8-4773-b8f4-641540da0707 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:05.701251 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:05.714275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac7ece-b9ec-4a0e-b106-72773fb4dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:05.715126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac7ece-b9ec-4a0e-b106-72773fb4dddd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.715522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac7ece-b9ec-4a0e-b106-72773fb4dddd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.715891 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac7ece-b9ec-4a0e-b106-72773fb4dddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.716980 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac7ece-b9ec-4a0e-b106-72773fb4dddd None admin] RBAC: Adding query filter params (role.id=664d5ea3869d4279ad66bd535835eecf, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=9f8cc9cf1454405f9cafb766c769a639) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:05.717372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac7ece-b9ec-4a0e-b106-72773fb4dddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:05.718928 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac7ece-b9ec-4a0e-b106-72773fb4dddd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:05.741450 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 125/255] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:05 2022] GET /identity/v3/role_assignments?user.id=9f8cc9cf1454405f9cafb766c769a639&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=664d5ea3869d4279ad66bd535835eecf => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:05.790708 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:05.793162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd92bd-7328-49fe-986e-07f1811e6d3e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.793584 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd92bd-7328-49fe-986e-07f1811e6d3e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.794270 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd92bd-7328-49fe-986e-07f1811e6d3e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.796591 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 126/256] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:05.796985 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5f2c2-8b75-4bb5-8c08-9e5c22c4b39e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:05.808520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4862b7-24da-453d-a71e-5eef7941d9b4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.808954 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4862b7-24da-453d-a71e-5eef7941d9b4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.809312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4862b7-24da-453d-a71e-5eef7941d9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.842026 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dc4862b7-24da-453d-a71e-5eef7941d9b4 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:05.843340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dc4862b7-24da-453d-a71e-5eef7941d9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:05.873632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:05.874803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:05.875475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:05.875931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:05.893786 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:05.909931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:05.910907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:05.912210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 131/257] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:05.921861 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.014209 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 127/258] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:06.072722 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4862b7-24da-453d-a71e-5eef7941d9b4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.082923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21fafd-6c4a-40b9-b4a8-651f7840bd09 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:06.126419 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:06.127457 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:06.127944 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:06.128398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:06.129332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:06.129814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:06.132081 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:06.145156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 132/259] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:06.151043 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.181856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:06.204240 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4862b7-24da-453d-a71e-5eef7941d9b4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:06.237555 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:06.257923 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:06.258774 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:06.259055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:06.259356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:06.271427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:06.279392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:06.280275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:06.281756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 128/260] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:06.283476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7061e-b0c4-49e9-aeb4-368f064b763b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:06.289501 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.331082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:06.332622 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:06.333268 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:06.333762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] PATH_INFO: `/v3/users/66a89a437e9b4c14ab78f74369ea8e86` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:06.335406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] RBAC: Authorizing `identity:get_user(user_id=66a89a437e9b4c14ab78f74369ea8e86)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:06.337218 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:06.339305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 133/261] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:06 2022] GET /identity/v3/users/66a89a437e9b4c14ab78f74369ea8e86 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:06.351660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.455404 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bdd63-0c46-408e-8fa8-206c7b3fef5a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:06.470671 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:06.492813 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233dcab6-69e7-4203-ac92-63e69cb5622c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:06.494434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:06.495209 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:06.495676 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:06.496049 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:06.497143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:06.497847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:06.499680 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:06.509167 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 129/262] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:06.515101 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.537661 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:06.538591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:06.539039 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:06.539494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:06.583665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:06.671550 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:06.673061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:06.704521 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551cebb-1e91-43d2-bf39-7f5255c36536 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:06.772419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:06.773708 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:06.774473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:06.774978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] PATH_INFO: `/v3/users/66a89a437e9b4c14ab78f74369ea8e86` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:06.778113 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] RBAC: Authorizing `identity:get_user(user_id=66a89a437e9b4c14ab78f74369ea8e86)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:06.781560 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:06.783974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 130/263] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:06 2022] GET /identity/v3/users/66a89a437e9b4c14ab78f74369ea8e86 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:06.790935 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.856099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:06.880124 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 134/264] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:06.886342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:06.950207 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e821b5-0406-473e-ac36-2732d46d48e1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:06.963875 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:07.012513 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:07.013356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:07.013672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:07.013928 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:07.047264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dd86f-7929-40a0-ad6b-b76d95fd8217 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:07.117873 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:07.121133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:07.121693 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:07.123843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:07.125542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:07.130102 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:07.133183 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 135/265] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:06 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:07.141600 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:07.153300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:07.154882 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:07.272332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:07.307903 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 131/266] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:07.315533 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:07.332417 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:07.371863 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cec809-a8ca-4b02-9c5c-331c48d00796 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:07.407767 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:07.408443 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:07.408722 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:07.408993 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:07.410012 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=66a89a437e9b4c14ab78f74369ea8e86) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:07.410120 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:07.411608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:07.418008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 136/267] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:07 2022] GET /identity/v3/role_assignments?user.id=66a89a437e9b4c14ab78f74369ea8e86&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=079434fe84194c03ae64e10d61e222e6 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:07.441087 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d5904-a3a7-4f64-9865-d6f1ec383122 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:07.485709 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748da234-70fe-48fa-b769-08064c504475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:07.487029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da234-70fe-48fa-b769-08064c504475 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:07.487561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da234-70fe-48fa-b769-08064c504475 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:07.488045 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748da234-70fe-48fa-b769-08064c504475 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:07.492870 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748da234-70fe-48fa-b769-08064c504475 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:07.494919 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748da234-70fe-48fa-b769-08064c504475 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:07.497066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 132/268] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:07 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:07.503627 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:07.640632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb840e7-5f46-450d-a109-1a36f2502d1e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:07.662917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:07.684391 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0a828-40d7-4c9a-b9ff-f6e8fb00be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:07.685211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a828-40d7-4c9a-b9ff-f6e8fb00be59 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:07.685568 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a828-40d7-4c9a-b9ff-f6e8fb00be59 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:07.685961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a828-40d7-4c9a-b9ff-f6e8fb00be59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:07.686831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0a828-40d7-4c9a-b9ff-f6e8fb00be59 None admin] RBAC: Adding query filter params (role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=66a89a437e9b4c14ab78f74369ea8e86) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:07.687144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0a828-40d7-4c9a-b9ff-f6e8fb00be59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:07.689134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0a828-40d7-4c9a-b9ff-f6e8fb00be59 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:07.700834 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 137/269] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:07 2022] GET /identity/v3/role_assignments?user.id=66a89a437e9b4c14ab78f74369ea8e86&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=81307e0920ce427d9422f90d0da01275 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:08.185082 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce6811-9ff7-4438-9c94-3a9d414bd9cf None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.186064 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce6811-9ff7-4438-9c94-3a9d414bd9cf None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.186610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce6811-9ff7-4438-9c94-3a9d414bd9cf None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.189254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 133/270] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:08.196271 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508688-7831-40ae-aacf-2128882acba1 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.197149 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508688-7831-40ae-aacf-2128882acba1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.197720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508688-7831-40ae-aacf-2128882acba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.216110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5c508688-7831-40ae-aacf-2128882acba1 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:08.217709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5c508688-7831-40ae-aacf-2128882acba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:08.292268 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 138/271] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:08.318798 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce6811-9ff7-4438-9c94-3a9d414bd9cf None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:08.406310 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:08.429492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce6811-9ff7-4438-9c94-3a9d414bd9cf None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:08.467983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:08.469180 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.469667 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.470138 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.482059 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:08.490690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:08.492610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:08.493418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:08.495968 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 134/272] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:08.502898 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508688-7831-40ae-aacf-2128882acba1 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:08.625257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508688-7831-40ae-aacf-2128882acba1 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:08.645138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:08.680805 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b07878-e2d4-42fd-8f77-2a11b10dcbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:08.681877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b07878-e2d4-42fd-8f77-2a11b10dcbff None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.682357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b07878-e2d4-42fd-8f77-2a11b10dcbff None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.682846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b07878-e2d4-42fd-8f77-2a11b10dcbff None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.683844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b07878-e2d4-42fd-8f77-2a11b10dcbff None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:08.684499 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b07878-e2d4-42fd-8f77-2a11b10dcbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:08.686910 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b07878-e2d4-42fd-8f77-2a11b10dcbff None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:08.697057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 139/273] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:08.703747 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:08.710651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aabb8-1c66-4e22-9d31-61e705dffdac None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.710933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aabb8-1c66-4e22-9d31-61e705dffdac None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.711156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6aabb8-1c66-4e22-9d31-61e705dffdac None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.712830 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 140/274] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:08.717979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434da4-e878-4e46-9be1-66da3ebaa77c None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.718346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434da4-e878-4e46-9be1-66da3ebaa77c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.718543 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca434da4-e878-4e46-9be1-66da3ebaa77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.736583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-ca434da4-e878-4e46-9be1-66da3ebaa77c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:08.737782 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-ca434da4-e878-4e46-9be1-66da3ebaa77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:08.808572 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 141/275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:08.835966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca434da4-e878-4e46-9be1-66da3ebaa77c None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:08.837329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372c9c4-f70a-4d8d-8c38-fc28fa2cdb4a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:08.876201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e118b-f829-44ef-af0b-e23a5899387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:08.877082 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e118b-f829-44ef-af0b-e23a5899387f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.877364 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e118b-f829-44ef-af0b-e23a5899387f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.877638 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e118b-f829-44ef-af0b-e23a5899387f None admin] PATH_INFO: `/v3/users/24a9cc905cb045249c9ffefe5fe717f8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.889347 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:08.893889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e118b-f829-44ef-af0b-e23a5899387f None admin] RBAC: Authorizing `identity:get_user(user_id=24a9cc905cb045249c9ffefe5fe717f8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:08.895953 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e118b-f829-44ef-af0b-e23a5899387f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:08.897981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 135/276] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:08 2022] GET /identity/v3/users/24a9cc905cb045249c9ffefe5fe717f8 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:08.899323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5feb1d-36fe-4572-9aec-e05f4ea71acb None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.899721 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5feb1d-36fe-4572-9aec-e05f4ea71acb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.900350 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5feb1d-36fe-4572-9aec-e05f4ea71acb None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.901672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 136/277] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:08.903499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5feb1d-36fe-4572-9aec-e05f4ea71acb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:08.954109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca434da4-e878-4e46-9be1-66da3ebaa77c None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:08.961753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:08.993339 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae70d1-fc95-4101-9f84-9817deed508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:08.994071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae70d1-fc95-4101-9f84-9817deed508b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:08.994357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae70d1-fc95-4101-9f84-9817deed508b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:08.994634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae70d1-fc95-4101-9f84-9817deed508b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:08.995873 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae70d1-fc95-4101-9f84-9817deed508b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:08.997937 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae70d1-fc95-4101-9f84-9817deed508b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:09.000294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 142/278] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:09.001322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25373d-d85f-4b23-a6bd-7770129d220b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.001609 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25373d-d85f-4b23-a6bd-7770129d220b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.001885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25373d-d85f-4b23-a6bd-7770129d220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.019408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5a25373d-d85f-4b23-a6bd-7770129d220b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:09.020630 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5a25373d-d85f-4b23-a6bd-7770129d220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:09.029134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5feb1d-36fe-4572-9aec-e05f4ea71acb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.064212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.064874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.065159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.065438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.066274 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, user.id=24a9cc905cb045249c9ffefe5fe717f8, scope.system=all) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:09.066588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:09.068064 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:09.083435 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 137/279] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 10:11:08 2022] GET /identity/v3/role_assignments?user.id=24a9cc905cb045249c9ffefe5fe717f8&scope.system=all&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:09.083435 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.122364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 143/280] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:09.124716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8793-c04f-4a86-a79e-d9a2b718455b None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.125079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8793-c04f-4a86-a79e-d9a2b718455b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8793-c04f-4a86-a79e-d9a2b718455b None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.128182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 144/281] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:09.136741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f044eb6-67ed-448a-bd66-fcbc356589d6 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.137073 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f044eb6-67ed-448a-bd66-fcbc356589d6 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.137357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f044eb6-67ed-448a-bd66-fcbc356589d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.158715 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-1f044eb6-67ed-448a-bd66-fcbc356589d6 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:09.160158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-1f044eb6-67ed-448a-bd66-fcbc356589d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:09.164119 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:09.210103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1188ac-369d-4bde-8ff1-9e55c3bc3209 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.243089 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 145/282] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:09.244760 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f044eb6-67ed-448a-bd66-fcbc356589d6 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.260493 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.261422 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.261841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.262349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.263241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:09.265138 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:09.286744 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:09.290162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 138/283] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:11:09 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:09.291013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.368757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f044eb6-67ed-448a-bd66-fcbc356589d6 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.409398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.410289 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.410576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.410849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.423029 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:09.431469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:09.432396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:09.433179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 146/284] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:09.438947 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8896dc-e68b-4b0a-ab95-cf35cfd013c2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.439443 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.463695 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:09.497567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.498633 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.499781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.500212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.514753 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:09.522843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:09.523983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:09.524881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:09.526887 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 139/285] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:09.533060 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.571209 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:09.582367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c121c8c-2a2a-499c-88e9-4747b2260360 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.634247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.635414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.635902 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.636377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.637383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:09.638015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:09.639669 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:09.652537 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 147/286] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:09.660541 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.680597 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf252c-313c-4848-9011-a5afb4b189ae None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.722155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.722155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.722155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.722538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.723133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:09.723966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:09.725396 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:09.734937 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 140/287] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:09.743559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.788386 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2ca99-ff29-45bc-b26c-7bde6d2845fc None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.791945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:09.844008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.845314 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.845939 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.846416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] PATH_INFO: `/v3/users/9f8cc9cf1454405f9cafb766c769a639` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.849075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] RBAC: Authorizing `identity:get_user(user_id=9f8cc9cf1454405f9cafb766c769a639)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:09.851820 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:09.860206 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 148/288] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/users/9f8cc9cf1454405f9cafb766c769a639 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:09.861488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:09.881190 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270214-afd6-45f3-8b61-8deb669f9e5f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:09.924044 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:09.924775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:09.927443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:09.929455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:09.929943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] PATH_INFO: `/v3/users/de42ea74a27841abbf2efc030c3fa8e8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:09.932604 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] RBAC: Authorizing `identity:get_user(user_id=de42ea74a27841abbf2efc030c3fa8e8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:09.935342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:09.940941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 141/289] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/users/de42ea74a27841abbf2efc030c3fa8e8 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:09.949569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:10.027519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6865ab3-c0b9-428c-8a87-a3bf543c372f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:10.093990 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:10.096398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:10.098134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:10.099195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:10.100865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:10.104899 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:10.106843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 149/290] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:10.127598 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:10.138163 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d84d42-fecd-4fca-a1ea-9a39688675c9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:10.150259 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:10.192090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:10.192757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:10.193039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:10.193316 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:10.295985 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:10.315627 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efef4c6-889e-4ad2-80b6-f491a68646c6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:10.331969 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:10.333463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:10.390772 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:10.391535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:10.391821 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:10.392099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/9f8cc9cf1454405f9cafb766c769a639/roles/664d5ea3869d4279ad66bd535835eecf` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:10.395571 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78f5cbfe8534463b2874b2b38757dd8, user_id=9f8cc9cf1454405f9cafb766c769a639, role_id=664d5ea3869d4279ad66bd535835eecf)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:10.397061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:10.423448 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 150/291] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:10 2022] PUT /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/users/9f8cc9cf1454405f9cafb766c769a639/roles/664d5ea3869d4279ad66bd535835eecf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:11:10.511723 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 142/292] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:10.518636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:10.650959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b0186-5335-4127-8cc5-60dbedf37b89 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:10.689119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b37b8-9947-44bc-a04b-e3779c810407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:10.690491 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b37b8-9947-44bc-a04b-e3779c810407 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:10.690977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b37b8-9947-44bc-a04b-e3779c810407 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:10.691547 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b37b8-9947-44bc-a04b-e3779c810407 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:10.692996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b37b8-9947-44bc-a04b-e3779c810407 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:10.694745 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b37b8-9947-44bc-a04b-e3779c810407 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:10.696913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 151/293] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:10 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:10.708574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:10.724082 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:10.823647 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9ffe0-73a1-489c-bea7-91689b00a1e5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:10.861087 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9dadc-48ec-4994-960d-663e39da6cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:10.861759 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9dadc-48ec-4994-960d-663e39da6cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:10.862046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9dadc-48ec-4994-960d-663e39da6cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:10.862323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9dadc-48ec-4994-960d-663e39da6cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:10.863170 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9dadc-48ec-4994-960d-663e39da6cb0 None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=de42ea74a27841abbf2efc030c3fa8e8) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:10.863517 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9dadc-48ec-4994-960d-663e39da6cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:10.864974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9dadc-48ec-4994-960d-663e39da6cb0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:10.871627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 143/294] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:10 2022] GET /identity/v3/role_assignments?user.id=de42ea74a27841abbf2efc030c3fa8e8&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:11.650132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fa9f-0f6b-426c-9ad6-3b7b059696b7 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:11.650673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fa9f-0f6b-426c-9ad6-3b7b059696b7 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:11.650673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fa9f-0f6b-426c-9ad6-3b7b059696b7 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:11.652362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 152/295] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:11.659483 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d4bb-0c47-427a-978d-5773f5e12e0f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:11.660348 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d4bb-0c47-427a-978d-5773f5e12e0f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:11.660832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d4bb-0c47-427a-978d-5773f5e12e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:11.678609 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-95a2d4bb-0c47-427a-978d-5773f5e12e0f None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:11.680147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-95a2d4bb-0c47-427a-978d-5773f5e12e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:11.753336 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 144/296] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:11.776215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8fa9f-0f6b-426c-9ad6-3b7b059696b7 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:11.804742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:11.907305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8fa9f-0f6b-426c-9ad6-3b7b059696b7 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:11.942783 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990c3cd-971f-4474-8b3c-b52879a5e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:11.943656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c3cd-971f-4474-8b3c-b52879a5e296 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:11.943945 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c3cd-971f-4474-8b3c-b52879a5e296 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:11.944225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990c3cd-971f-4474-8b3c-b52879a5e296 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:11.955191 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990c3cd-971f-4474-8b3c-b52879a5e296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-f990c3cd-971f-4474-8b3c-b52879a5e296 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:11.963000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:11.963879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:11.964651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 153/297] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:11.972631 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d4bb-0c47-427a-978d-5773f5e12e0f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:11.974877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:12.073955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf978cd5-070b-49cd-b694-136e3844cdcc None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.074306 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf978cd5-070b-49cd-b694-136e3844cdcc None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.074513 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf978cd5-070b-49cd-b694-136e3844cdcc None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.076092 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 154/298] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:12.082509 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5745-27a1-422d-8018-c3b55312edf7 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.083150 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5745-27a1-422d-8018-c3b55312edf7 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.083662 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5745-27a1-422d-8018-c3b55312edf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.089384 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d4bb-0c47-427a-978d-5773f5e12e0f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.101815 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-f7ad5745-27a1-422d-8018-c3b55312edf7 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:12.103299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-f7ad5745-27a1-422d-8018-c3b55312edf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:12.125264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b401e-af2c-42ee-996a-76e1feec966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.125941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b401e-af2c-42ee-996a-76e1feec966d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.126219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b401e-af2c-42ee-996a-76e1feec966d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.126492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b401e-af2c-42ee-996a-76e1feec966d None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.127267 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b401e-af2c-42ee-996a-76e1feec966d None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:12.127600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b401e-af2c-42ee-996a-76e1feec966d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:12.128976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b401e-af2c-42ee-996a-76e1feec966d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:12.137162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 145/299] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:12.144642 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462c62e-b345-4697-8393-e9c8a09473da None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.144913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462c62e-b345-4697-8393-e9c8a09473da None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.145191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462c62e-b345-4697-8393-e9c8a09473da None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.146756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 146/300] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:12.147317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462c62e-b345-4697-8393-e9c8a09473da None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:12.183676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 155/301] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:12.183676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cf93-e50c-4066-be1d-4c87335f75df None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.183676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cf93-e50c-4066-be1d-4c87335f75df None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.183676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cf93-e50c-4066-be1d-4c87335f75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.206431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5fb5cf93-e50c-4066-be1d-4c87335f75df None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:12.207659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5fb5cf93-e50c-4066-be1d-4c87335f75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:12.211625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:12.226176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:12.267298 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462c62e-b345-4697-8393-e9c8a09473da None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.283467 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 156/302] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:12.284188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cf93-e50c-4066-be1d-4c87335f75df None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:12.326303 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.327203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.327523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.327803 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] PATH_INFO: `/v3/users/24a9cc905cb045249c9ffefe5fe717f8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.329010 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=24a9cc905cb045249c9ffefe5fe717f8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:12.330473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:12.336521 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 147/303] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:12 2022] GET /identity/v3/users/24a9cc905cb045249c9ffefe5fe717f8 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:12.336521 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:12.398257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cf93-e50c-4066-be1d-4c87335f75df None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.434103 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.435027 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5790ef-68bc-4ad2-866a-773f3750a8a9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.435143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.435241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.435487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.436704 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:12.438259 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:12.440429 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 157/304] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:12.443766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:12.456302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:12.466927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:12.472278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.473684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.474224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.474992 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.486110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:12.493898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:12.495112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 148/305] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:12.500467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:12.563122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de149-0cd3-439b-8762-c068e56c6fe0 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.598867 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.599917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.600290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.600657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] PATH_INFO: `/v3/system/users/24a9cc905cb045249c9ffefe5fe717f8/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.601415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbac7e-79cf-417c-ba0c-d9e10db64e50 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.602333 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=24a9cc905cb045249c9ffefe5fe717f8, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:12.604525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:12.614471 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 158/306] 10.222.0.67 () {58 vars in 1334 bytes} [Wed May 25 10:11:12 2022] PUT /identity/v3/system/users/24a9cc905cb045249c9ffefe5fe717f8/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:12.623614 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:12.653949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.654862 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.655335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.655678 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] PATH_INFO: `/v3/groups` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.656471 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:12.658154 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:12.677692 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 149/307] 10.222.0.67 () {60 vars in 1134 bytes} [Wed May 25 10:11:12 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:12.714533 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:12.758786 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97e292-32f2-4de5-ac27-39420c9a62b8 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.801608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.802649 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.803114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.803697 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.804735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:12.805251 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:12.806934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:12.818316 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 159/308] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:12.824363 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:12.894006 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:12.945399 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ef245-07fb-4466-8d2b-208710266b41 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:12.981203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeba9d8-f5d1-4e23-b162-d03a143ef59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:12.982049 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeba9d8-f5d1-4e23-b162-d03a143ef59f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:12.982336 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeba9d8-f5d1-4e23-b162-d03a143ef59f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:12.982614 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeba9d8-f5d1-4e23-b162-d03a143ef59f None admin] PATH_INFO: `/v3/users/0a3b8dbf57e142f0a8bce9b5770b937d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:12.997052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeba9d8-f5d1-4e23-b162-d03a143ef59f None admin] RBAC: Authorizing `identity:get_user(user_id=0a3b8dbf57e142f0a8bce9b5770b937d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:12.998553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeba9d8-f5d1-4e23-b162-d03a143ef59f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:13.000744 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 150/309] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:12 2022] GET /identity/v3/users/0a3b8dbf57e142f0a8bce9b5770b937d => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:13.006696 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:13.115521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a428d2ec-b1ea-46bb-8941-0c6c05f444ac None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:13.151058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2deee5-b031-44f7-98b5-c6ee32988733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:13.152132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2deee5-b031-44f7-98b5-c6ee32988733 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:13.152615 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2deee5-b031-44f7-98b5-c6ee32988733 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:13.153084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2deee5-b031-44f7-98b5-c6ee32988733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:13.154453 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2deee5-b031-44f7-98b5-c6ee32988733 None admin] RBAC: Adding query filter params (role.id=664d5ea3869d4279ad66bd535835eecf, user.id=0a3b8dbf57e142f0a8bce9b5770b937d, scope.system=all) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:13.154971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2deee5-b031-44f7-98b5-c6ee32988733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:13.156677 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2deee5-b031-44f7-98b5-c6ee32988733 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:13.162535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 160/310] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 10:11:13 2022] GET /identity/v3/role_assignments?user.id=0a3b8dbf57e142f0a8bce9b5770b937d&scope.system=all&role.id=664d5ea3869d4279ad66bd535835eecf => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:13.163013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:13.293826 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c162e-12d4-4129-9752-0473a5d6470f None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:13.294472 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c162e-12d4-4129-9752-0473a5d6470f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:13.294761 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c162e-12d4-4129-9752-0473a5d6470f None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:13.296546 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 151/311] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:13.302549 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791abb9-28e0-46c6-bc7f-f0e220a3cc66 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:13.302839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791abb9-28e0-46c6-bc7f-f0e220a3cc66 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:13.303118 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791abb9-28e0-46c6-bc7f-f0e220a3cc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:13.328102 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-d791abb9-28e0-46c6-bc7f-f0e220a3cc66 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:13.329684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-d791abb9-28e0-46c6-bc7f-f0e220a3cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:13.401771 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 161/312] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:13.427573 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c162e-12d4-4129-9752-0473a5d6470f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:13.534947 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c162e-12d4-4129-9752-0473a5d6470f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:13.547038 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:13.571751 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:13.572571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:13.572857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:13.573134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:13.586321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:13.594323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:13.595191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:13.595996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 152/313] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:13.601948 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791abb9-28e0-46c6-bc7f-f0e220a3cc66 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:13.704798 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791abb9-28e0-46c6-bc7f-f0e220a3cc66 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:13.733290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:13.742730 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:13.743468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:13.743761 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:13.744042 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:13.744803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:13.745115 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:13.746521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:13.755452 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 162/314] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:13.761166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:13.867321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcc882-7abf-4001-84f3-b1e13d9c174f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:13.907256 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:13.908197 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:13.908483 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:13.908764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] PATH_INFO: `/v3/users/9f8cc9cf1454405f9cafb766c769a639` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:13.910120 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] RBAC: Authorizing `identity:get_user(user_id=9f8cc9cf1454405f9cafb766c769a639)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:13.911724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:13.918181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 153/315] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:13 2022] GET /identity/v3/users/9f8cc9cf1454405f9cafb766c769a639 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:13.919444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:14.034816 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9325f-6b19-42d5-b1aa-a1cc5bea795a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:14.070604 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:14.071268 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:14.071578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:14.071856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:14.141193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:14.152562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:14.154111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:14.253063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 163/316] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:14.259037 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:14.300647 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:14.371309 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8c134-d8be-4042-88e3-4aa90a9ebab5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:14.410008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1b525-98c7-4f9f-a530-007bc46b62ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:14.411414 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b525-98c7-4f9f-a530-007bc46b62ff None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:14.411899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b525-98c7-4f9f-a530-007bc46b62ff None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:14.412378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b525-98c7-4f9f-a530-007bc46b62ff None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:14.413741 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1b525-98c7-4f9f-a530-007bc46b62ff None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:14.415739 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1b525-98c7-4f9f-a530-007bc46b62ff None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:14.417812 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 154/317] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:14 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:14.423938 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:14.520382 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:14.531918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650d315-ff9b-4f53-b896-0eca676ab9de None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:14.569921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b4f70-1d82-42d8-8159-5aa4d044541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:14.570601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b4f70-1d82-42d8-8159-5aa4d044541c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:14.570884 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b4f70-1d82-42d8-8159-5aa4d044541c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:14.571156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b4f70-1d82-42d8-8159-5aa4d044541c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:14.572142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b4f70-1d82-42d8-8159-5aa4d044541c None admin] RBAC: Adding query filter params (role.id=664d5ea3869d4279ad66bd535835eecf, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8, user.id=9f8cc9cf1454405f9cafb766c769a639) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:14.572350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b4f70-1d82-42d8-8159-5aa4d044541c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:14.573810 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b4f70-1d82-42d8-8159-5aa4d044541c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:14.580264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 164/318] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:14 2022] GET /identity/v3/role_assignments?user.id=9f8cc9cf1454405f9cafb766c769a639&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=664d5ea3869d4279ad66bd535835eecf => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:15.083931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0051d-c53c-4368-ae68-4ed0c4e9fae5 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.084459 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0051d-c53c-4368-ae68-4ed0c4e9fae5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.084459 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0051d-c53c-4368-ae68-4ed0c4e9fae5 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.085882 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 155/319] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:15.091852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93deed11-b23a-414a-a0a7-33770ab017c8 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.092302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93deed11-b23a-414a-a0a7-33770ab017c8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.092384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93deed11-b23a-414a-a0a7-33770ab017c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.109496 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-93deed11-b23a-414a-a0a7-33770ab017c8 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:15.110687 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-93deed11-b23a-414a-a0a7-33770ab017c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:15.145616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400de50-c4ac-4e93-a5d7-b51274a39061 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.145848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400de50-c4ac-4e93-a5d7-b51274a39061 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.146100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400de50-c4ac-4e93-a5d7-b51274a39061 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.147503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 156/320] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:15.152874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8bca-cb63-40f6-81ef-3fc1b6ba1ee9 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.153260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8bca-cb63-40f6-81ef-3fc1b6ba1ee9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.153490 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb8bca-cb63-40f6-81ef-3fc1b6ba1ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.170126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-29eb8bca-cb63-40f6-81ef-3fc1b6ba1ee9 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:15.171323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-29eb8bca-cb63-40f6-81ef-3fc1b6ba1ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:15.184233 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 165/321] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:15.209638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93deed11-b23a-414a-a0a7-33770ab017c8 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:15.242665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 157/322] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:15.266063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8bca-cb63-40f6-81ef-3fc1b6ba1ee9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:15.302828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:15.305064 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:15.323175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93deed11-b23a-414a-a0a7-33770ab017c8 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:15.361846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:15.362594 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.362927 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.363203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.376549 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:15.376803 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb8bca-cb63-40f6-81ef-3fc1b6ba1ee9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:15.384462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:15.385583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 166/323] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:15.391819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:15.423081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:15.423958 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.424241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.424525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.425684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:15.427137 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:15.429266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 158/324] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:15.435827 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:15.505754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fb644-2982-4dce-a1a9-fe4d1a186ebc None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:15.540833 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dbf00-2ebc-4491-b260-8815047e4a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:15.541517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dbf00-2ebc-4491-b260-8815047e4a1c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.541800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dbf00-2ebc-4491-b260-8815047e4a1c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.541973 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7132bc-5b38-428d-95a1-4296658f93f4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:15.542073 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dbf00-2ebc-4491-b260-8815047e4a1c None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.542810 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dbf00-2ebc-4491-b260-8815047e4a1c None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:15.543118 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dbf00-2ebc-4491-b260-8815047e4a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:15.544777 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8dbf00-2ebc-4491-b260-8815047e4a1c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:15.546317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:15.553476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 167/325] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:15.557032 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700fcb-09d0-4b30-91d3-6c071c4628f3 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.557322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700fcb-09d0-4b30-91d3-6c071c4628f3 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.557597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae700fcb-09d0-4b30-91d3-6c071c4628f3 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.558857 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 168/326] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:15.559620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700fcb-09d0-4b30-91d3-6c071c4628f3 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:15.571750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:15.580513 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc408e-702f-466f-9215-35d2ca22c724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:15.581184 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc408e-702f-466f-9215-35d2ca22c724 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.581462 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc408e-702f-466f-9215-35d2ca22c724 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.581733 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc408e-702f-466f-9215-35d2ca22c724 None admin] PATH_INFO: `/v3/groups` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.582424 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc408e-702f-466f-9215-35d2ca22c724 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:15.583930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc408e-702f-466f-9215-35d2ca22c724 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:15.598566 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 159/327] 10.222.0.67 () {60 vars in 1134 bytes} [Wed May 25 10:11:15 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:11:15.600158 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e6a0c-e598-49b9-a142-d47bb58a2e90 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.600450 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e6a0c-e598-49b9-a142-d47bb58a2e90 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.600995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e6a0c-e598-49b9-a142-d47bb58a2e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.620063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0b3e6a0c-e598-49b9-a142-d47bb58a2e90 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:15.621217 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0b3e6a0c-e598-49b9-a142-d47bb58a2e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:15.691552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae700fcb-09d0-4b30-91d3-6c071c4628f3 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:15.696412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 160/328] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:15.720463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e6a0c-e598-49b9-a142-d47bb58a2e90 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:15.731557 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:15.732484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.733114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.733399 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] PATH_INFO: `/v3/users/24a9cc905cb045249c9ffefe5fe717f8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.734899 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] RBAC: Authorizing `identity:get_user(user_id=24a9cc905cb045249c9ffefe5fe717f8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:15.736502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:15.738237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 169/329] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:15 2022] GET /identity/v3/users/24a9cc905cb045249c9ffefe5fe717f8 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:15.744326 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:15.833688 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:15.844900 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:15.853885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e6a0c-e598-49b9-a142-d47bb58a2e90 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:15.862265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5b30-9f3b-445b-9fb6-c691291c558f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:15.899563 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:15.899751 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.900015 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.903294 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.903440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:15.903440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:15.903440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:15.903440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:15.903915 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] RBAC: Adding query filter params (role.id=8b6c1d1fbb554fcab560889bed4612cc, user.id=24a9cc905cb045249c9ffefe5fe717f8, scope.system=all) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:15.904237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:15.905704 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:15.915126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:15.920430 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 170/330] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 10:11:15 2022] GET /identity/v3/role_assignments?user.id=24a9cc905cb045249c9ffefe5fe717f8&scope.system=all&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:15.923017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:15.924118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:15.924901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:15.927011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 161/331] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:15.933412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:16.062349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61e491-9a5a-4b45-98e6-2b59f69037f5 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:16.099868 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:16.115028 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:16.115862 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:16.116146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:16.116420 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:16.117178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:16.117485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:16.118889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:16.130614 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 171/332] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:16.138033 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:16.258864 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04477bd-9f9f-411d-b60f-e0e95ec44685 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:16.298111 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dc2b1-5741-4afe-97eb-b42c6a8decb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:16.299378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc2b1-5741-4afe-97eb-b42c6a8decb9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:16.299843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc2b1-5741-4afe-97eb-b42c6a8decb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:16.300312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dc2b1-5741-4afe-97eb-b42c6a8decb9 None admin] PATH_INFO: `/v3/users/0a3b8dbf57e142f0a8bce9b5770b937d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:16.301709 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dc2b1-5741-4afe-97eb-b42c6a8decb9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a3b8dbf57e142f0a8bce9b5770b937d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:16.303464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dc2b1-5741-4afe-97eb-b42c6a8decb9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:16.305327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 162/333] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:16 2022] GET /identity/v3/users/0a3b8dbf57e142f0a8bce9b5770b937d => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:16.311193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:16.416956 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75341392-020e-41d4-b28c-c8c89e15f656 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:16.452897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de432b-42d5-4461-b45b-8d9f9ade4c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:16.453779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de432b-42d5-4461-b45b-8d9f9ade4c21 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:16.454061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de432b-42d5-4461-b45b-8d9f9ade4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:16.454334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de432b-42d5-4461-b45b-8d9f9ade4c21 None admin] PATH_INFO: `/v3/system/users/0a3b8dbf57e142f0a8bce9b5770b937d/roles/664d5ea3869d4279ad66bd535835eecf` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:16.455852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de432b-42d5-4461-b45b-8d9f9ade4c21 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a3b8dbf57e142f0a8bce9b5770b937d, role_id=664d5ea3869d4279ad66bd535835eecf)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:16.457274 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de432b-42d5-4461-b45b-8d9f9ade4c21 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:16.469553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 172/334] 10.222.0.67 () {58 vars in 1334 bytes} [Wed May 25 10:11:16 2022] PUT /identity/v3/system/users/0a3b8dbf57e142f0a8bce9b5770b937d/roles/664d5ea3869d4279ad66bd535835eecf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:18.147702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d2bb-85cf-4ef1-9655-623a1646ec3c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:18.148709 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d2bb-85cf-4ef1-9655-623a1646ec3c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:18.149271 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d2bb-85cf-4ef1-9655-623a1646ec3c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:18.151175 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 163/335] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:18.156369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7895cf-3991-46c1-b530-ee9ca17462ff None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:18.157206 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7895cf-3991-46c1-b530-ee9ca17462ff None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:18.157690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7895cf-3991-46c1-b530-ee9ca17462ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:18.182807 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-4c7895cf-3991-46c1-b530-ee9ca17462ff None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:18.184805 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-4c7895cf-3991-46c1-b530-ee9ca17462ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:18.256958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:18.277667 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 173/336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:18.318206 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d2bb-85cf-4ef1-9655-623a1646ec3c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:18.350176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:18.451062 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d2bb-85cf-4ef1-9655-623a1646ec3c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:18.493908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:18.495893 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:18.495893 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:18.495893 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:18.516257 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:18.524311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:18.528526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:18.529367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 164/337] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:18.532071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7895cf-3991-46c1-b530-ee9ca17462ff None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:18.673906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7895cf-3991-46c1-b530-ee9ca17462ff None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:18.719125 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a344d9-adb3-4e68-aebd-6b59af7a12a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:18.719755 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a344d9-adb3-4e68-aebd-6b59af7a12a6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:18.720035 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a344d9-adb3-4e68-aebd-6b59af7a12a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:18.720308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a344d9-adb3-4e68-aebd-6b59af7a12a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:18.721060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a344d9-adb3-4e68-aebd-6b59af7a12a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:18.721366 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a344d9-adb3-4e68-aebd-6b59af7a12a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:18.722754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a344d9-adb3-4e68-aebd-6b59af7a12a6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:18.732242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 174/338] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:18.737541 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:18.861227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:18.885327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1a273-8cc6-4436-99fd-295ee7242696 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:18.923096 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:18.923804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:18.924084 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:18.924358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:18.978206 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d32fc-b4ae-45ba-ab44-db1e8a1fce6c None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:18.978498 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d32fc-b4ae-45ba-ab44-db1e8a1fce6c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:18.978675 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d32fc-b4ae-45ba-ab44-db1e8a1fce6c None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:18.980352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 175/339] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:18.988777 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579ace-1b14-45be-b4ab-8d8a508d3a0f None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:18.989067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579ace-1b14-45be-b4ab-8d8a508d3a0f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:18.989341 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579ace-1b14-45be-b4ab-8d8a508d3a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.000256 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:19.002274 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:19.012879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-34579ace-1b14-45be-b4ab-8d8a508d3a0f None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:19.014214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-34579ace-1b14-45be-b4ab-8d8a508d3a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:19.075342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:19.102666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 176/340] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:19.109115 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:19.130686 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 165/341] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:19.131613 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579ace-1b14-45be-b4ab-8d8a508d3a0f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:19.146790 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:19.316731 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579ace-1b14-45be-b4ab-8d8a508d3a0f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:19.317658 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad7cb6-96f6-41bb-bdc7-3ff1c09926f8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:19.359988 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43e7ea-0574-4568-9d66-bc2b7cbc00e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:19.360877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e7ea-0574-4568-9d66-bc2b7cbc00e2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:19.361163 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e7ea-0574-4568-9d66-bc2b7cbc00e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:19.361439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43e7ea-0574-4568-9d66-bc2b7cbc00e2 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.363614 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e7ea-0574-4568-9d66-bc2b7cbc00e2 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:19.365101 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43e7ea-0574-4568-9d66-bc2b7cbc00e2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:19.369407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 166/342] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:19 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:19.370659 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6522e65-461a-4b51-8833-345b6c3c3a71 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:19.370946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6522e65-461a-4b51-8833-345b6c3c3a71 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:19.371221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6522e65-461a-4b51-8833-345b6c3c3a71 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.376848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 167/343] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:19.378223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6522e65-461a-4b51-8833-345b6c3c3a71 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:19.394377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2670570-0cd9-4cfd-a2e4-b44441effb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:19.396702 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2670570-0cd9-4cfd-a2e4-b44441effb9c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:19.397203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2670570-0cd9-4cfd-a2e4-b44441effb9c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:19.397672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2670570-0cd9-4cfd-a2e4-b44441effb9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.419746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2670570-0cd9-4cfd-a2e4-b44441effb9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-b2670570-0cd9-4cfd-a2e4-b44441effb9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:19.428248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:19.429139 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:19.429921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:19.432669 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 177/344] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:19.436387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a5c7-893b-40f7-8831-2d8635ca482e None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:19.436963 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a5c7-893b-40f7-8831-2d8635ca482e None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:19.437454 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41a5c7-893b-40f7-8831-2d8635ca482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.459787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:19.469396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-de41a5c7-893b-40f7-8831-2d8635ca482e None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:19.472185 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-de41a5c7-893b-40f7-8831-2d8635ca482e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:19.536808 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6522e65-461a-4b51-8833-345b6c3c3a71 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:19.546244 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:19.607001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:19.608986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 178/345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:19.609722 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:19.610047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:19.610337 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.610992 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41a5c7-893b-40f7-8831-2d8635ca482e None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:19.625540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:19.627073 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:19.629568 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 168/346] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:19 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:19.637347 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:19.787187 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41a5c7-893b-40f7-8831-2d8635ca482e None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:19.794039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2e265-e4ad-4500-8cbf-1c8a10abc570 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:19.822494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:19.855814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:19.856552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:19.856826 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:19.857178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.857868 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:19.858177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:19.859610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:19.865824 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:19.866502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:19.866791 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:19.867071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:19.867951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:19.868270 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:19.869751 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:19.880548 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 179/347] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:19.881415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:19.883772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 169/348] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:19 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:19.886818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:19.932779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:20.003802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8cf4-e9c3-4c15-956d-dd75e4e57281 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:20.055313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:20.056294 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.056739 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.057202 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.062664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143283-0947-432a-92b3-ee92b2de2328 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:20.117254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:20.145984 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:20.147949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:20.176757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:20.178033 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.178517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.178986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.198808 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:20.213327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:20.214311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:20.215113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:20.218897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 180/349] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:20.224466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:20.266415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 170/350] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:20.273243 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:20.391025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:20.393055 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:20.409429 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf42b8-1212-42cb-b6df-1afc61f80648 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:20.411527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9c0a6-e852-401f-93ab-27821c94891d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:20.447902 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42041f19-5d35-4e6e-bcca-0cf90ee1a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:20.449035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42041f19-5d35-4e6e-bcca-0cf90ee1a5e9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.449528 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42041f19-5d35-4e6e-bcca-0cf90ee1a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.449998 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42041f19-5d35-4e6e-bcca-0cf90ee1a5e9 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.452449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42041f19-5d35-4e6e-bcca-0cf90ee1a5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:20.454089 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42041f19-5d35-4e6e-bcca-0cf90ee1a5e9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:20.456208 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 171/351] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:20 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:20.457548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c230-56b9-417c-a9d0-e2aec900e459 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.457988 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c230-56b9-417c-a9d0-e2aec900e459 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.458405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c230-56b9-417c-a9d0-e2aec900e459 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.464131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 172/352] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:20.465406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c230-56b9-417c-a9d0-e2aec900e459 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:20.517010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f9517-ec51-4424-b911-f28204745abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:20.518003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9517-ec51-4424-b911-f28204745abe None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.518444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9517-ec51-4424-b911-f28204745abe None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.518864 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f9517-ec51-4424-b911-f28204745abe None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.519823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f9517-ec51-4424-b911-f28204745abe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:20.520282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f9517-ec51-4424-b911-f28204745abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:20.521885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f9517-ec51-4424-b911-f28204745abe None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:20.553739 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 181/353] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:20.555375 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abec93-ec84-4982-9dae-f0ae11b76ef1 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.555819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abec93-ec84-4982-9dae-f0ae11b76ef1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.556243 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abec93-ec84-4982-9dae-f0ae11b76ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.580486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c230-56b9-417c-a9d0-e2aec900e459 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:20.600348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-31abec93-ec84-4982-9dae-f0ae11b76ef1 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:20.601581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-31abec93-ec84-4982-9dae-f0ae11b76ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:20.618456 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:20.619655 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.620709 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.621132 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.623252 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:20.625264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:20.627401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 173/354] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:20 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:20.628416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:20.652756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:20.718244 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 182/355] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:20.719129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abec93-ec84-4982-9dae-f0ae11b76ef1 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:20.740048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c6ed9-2a13-4d0e-86ee-17565e3e070c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:20.775767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b24349-b0f2-43c2-9f6a-1f31c49edd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:20.776677 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b24349-b0f2-43c2-9f6a-1f31c49edd15 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.777081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b24349-b0f2-43c2-9f6a-1f31c49edd15 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.777477 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b24349-b0f2-43c2-9f6a-1f31c49edd15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.815695 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:20.837679 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abec93-ec84-4982-9dae-f0ae11b76ef1 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:20.867893 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b24349-b0f2-43c2-9f6a-1f31c49edd15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:20.869352 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b24349-b0f2-43c2-9f6a-1f31c49edd15 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:20.886735 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:20.888788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1350f-b33c-4ff6-a4af-da1d1b74f65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:20.891596 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1350f-b33c-4ff6-a4af-da1d1b74f65b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.891722 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1350f-b33c-4ff6-a4af-da1d1b74f65b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.891971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1350f-b33c-4ff6-a4af-da1d1b74f65b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.892843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1350f-b33c-4ff6-a4af-da1d1b74f65b None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:20.893163 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1350f-b33c-4ff6-a4af-da1d1b74f65b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:20.894635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1350f-b33c-4ff6-a4af-da1d1b74f65b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:20.905826 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 183/356] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:20 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:20.906882 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c28cc-e5d5-49ca-aa2d-a11ec6e0d026 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:20.907170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c28cc-e5d5-49ca-aa2d-a11ec6e0d026 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:20.907479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c28cc-e5d5-49ca-aa2d-a11ec6e0d026 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:20.909030 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 184/357] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:20.911002 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c28cc-e5d5-49ca-aa2d-a11ec6e0d026 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.007407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 174/358] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:21.008881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb17e-303f-4c4c-b6c8-40bdabeaeba9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.015003 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb17e-303f-4c4c-b6c8-40bdabeaeba9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.015454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb17e-303f-4c4c-b6c8-40bdabeaeba9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.017344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 175/359] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:21.018641 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622ba4e-f92b-4e3f-aa29-46db69a6a19f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.018936 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622ba4e-f92b-4e3f-aa29-46db69a6a19f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.019217 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622ba4e-f92b-4e3f-aa29-46db69a6a19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.038849 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1622ba4e-f92b-4e3f-aa29-46db69a6a19f None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:21.040139 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1622ba4e-f92b-4e3f-aa29-46db69a6a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:21.081402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c28cc-e5d5-49ca-aa2d-a11ec6e0d026 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.137382 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 176/360] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:21.138356 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39ef4d-3926-4274-96ca-ce8c8ed5b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.138849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ef4d-3926-4274-96ca-ce8c8ed5b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.139136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ef4d-3926-4274-96ca-ce8c8ed5b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.139461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ef4d-3926-4274-96ca-ce8c8ed5b9f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.143347 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622ba4e-f92b-4e3f-aa29-46db69a6a19f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.164934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39ef4d-3926-4274-96ca-ce8c8ed5b9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-1a39ef4d-3926-4274-96ca-ce8c8ed5b9f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:21.180138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:21.181286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 10:11:21.182336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:21.185290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 185/361] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:21.186727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9badd-ce49-44f7-b560-abfcec041aad None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.187109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9badd-ce49-44f7-b560-abfcec041aad None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.187502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9badd-ce49-44f7-b560-abfcec041aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.207440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-08f9badd-ce49-44f7-b560-abfcec041aad None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:21.208830 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-08f9badd-ce49-44f7-b560-abfcec041aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:21.209340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:21.212539 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:21.269307 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622ba4e-f92b-4e3f-aa29-46db69a6a19f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.293144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 186/362] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:21.299263 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9badd-ce49-44f7-b560-abfcec041aad None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.307523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.308675 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.309183 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.309887 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.311489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:21.313219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:21.315496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 177/363] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:21.316449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.422967 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10c989-80b3-4991-b46e-be2fe64eb255 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.438293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:21.445272 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9badd-ce49-44f7-b560-abfcec041aad None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.463046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.464171 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.464664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.465195 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.466285 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:21.466854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:21.468472 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:21.479118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 178/364] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:21.480498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.488248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.489144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.489431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.489701 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.499369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:21.506810 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:21.516180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:21.517083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:21.517865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:21.523717 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 187/365] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:21.524576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.618671 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482607-d8c9-407f-8f66-e2e8b123c15d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.666687 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47398c7b-e24d-4017-aa16-618f22959d86 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.667029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.667863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.668254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.668642 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.670709 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:21.672235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:21.674312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 179/366] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:21.675041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.716548 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.717381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.717666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.717941 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.731241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:21.732520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:21.740690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:21.741577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:21.742352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:21.742958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 188/367] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:21.748090 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.801403 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338c8ab-b710-464a-a4c9-6ffa49a8b27a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.831572 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:21.855939 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.857150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.857495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.857787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] PATH_INFO: `/v3/users/0a3b8dbf57e142f0a8bce9b5770b937d` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.859442 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] RBAC: Authorizing `identity:get_user(user_id=0a3b8dbf57e142f0a8bce9b5770b937d)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:21.861522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:21.863559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 180/368] 10.222.0.67 () {56 vars in 1177 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/users/0a3b8dbf57e142f0a8bce9b5770b937d => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:21.864141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.889239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3331e-c8d5-4a16-a4e1-14d37b2d15a9 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:21.936922 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:21.937959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:21.939075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:21.939576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:21.941170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:21.941693 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:21.943789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:21.957303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 189/369] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:21.958532 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:21.991244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847736bd-342a-4622-b9db-fea9a03c510f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:22.003491 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:22.031086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:22.031931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:22.032285 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:22.032635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:22.033556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:22.033970 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:22.035542 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:22.046619 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 181/370] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=81307e0920ce427d9422f90d0da01275 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:22.047768 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:22.104990 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4bcef-4da0-413e-b099-44d7cd814444 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:22.131626 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:22.150159 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:22.151346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:22.151884 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:22.152360 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:22.153476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:22.154041 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:22.155733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:22.173016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 190/371] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:22.174224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:22.225996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6763ab-0368-41df-ad72-f5693c3f4e4f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:22.275023 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:22.279932 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:22.280218 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:22.280499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:22.281421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] RBAC: Adding query filter params (role.id=664d5ea3869d4279ad66bd535835eecf, user.id=0a3b8dbf57e142f0a8bce9b5770b937d, scope.system=all) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:22.281680 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:22.283302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:22.301398 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 182/372] 10.222.0.67 () {56 vars in 1308 bytes} [Wed May 25 10:11:22 2022] GET /identity/v3/role_assignments?user.id=0a3b8dbf57e142f0a8bce9b5770b937d&scope.system=all&role.id=664d5ea3869d4279ad66bd535835eecf => generated 510 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:22.301906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed7500-cfca-4ac5-84f5-a9ce0e60024e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:22.302268 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:22.348060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:22.349322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:22.349836 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:22.350754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:22.408648 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:22.424213 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:22.450400 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:22.452832 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:22.525157 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31fbf-41b5-4def-a4ce-5ae40a74cc0c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:22.572016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 191/373] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:22.580606 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:22.588108 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683672-8864-459b-953e-2bb45b7601de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:22.588799 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683672-8864-459b-953e-2bb45b7601de None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:22.589086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683672-8864-459b-953e-2bb45b7601de None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:22.589365 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03683672-8864-459b-953e-2bb45b7601de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:22.700489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683672-8864-459b-953e-2bb45b7601de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:22.701063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03683672-8864-459b-953e-2bb45b7601de None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:22.710259 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:22.733924 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176e88-2806-4293-aad5-d615786e9918 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:22.736872 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:22.776311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:22.777620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:22.778175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:22.778744 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:22.780319 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:22.782069 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:22.784077 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 192/374] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:22 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:22.796053 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:22.814773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 183/375] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:22.826410 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683672-8864-459b-953e-2bb45b7601de None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:22.934011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03683672-8864-459b-953e-2bb45b7601de None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:22.968325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:22.976661 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:22.977558 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:22.977852 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:22.978132 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] PATH_INFO: `/v3/projects/460d90891ba54a98b3b62dfbf4e206e2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:22.979593 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] RBAC: Authorizing `identity:get_project(project_id=460d90891ba54a98b3b62dfbf4e206e2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:22.981548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:22.984029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 184/376] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:22 2022] GET /identity/v3/projects/460d90891ba54a98b3b62dfbf4e206e2 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:22.989773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:23.040569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73e834-7f06-47b0-b976-62cc709f314d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:23.089465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5870af8-c82b-4eef-84c8-f66ea4c105a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:23.091230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870af8-c82b-4eef-84c8-f66ea4c105a6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.091892 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870af8-c82b-4eef-84c8-f66ea4c105a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.092388 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870af8-c82b-4eef-84c8-f66ea4c105a6 None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.093818 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5870af8-c82b-4eef-84c8-f66ea4c105a6 None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:23.095529 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5870af8-c82b-4eef-84c8-f66ea4c105a6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:23.097688 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 193/377] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:22 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:23.099150 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f304-327f-4965-b27e-12253e94459f None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.099673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f304-327f-4965-b27e-12253e94459f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.100145 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8f304-327f-4965-b27e-12253e94459f None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.101832 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 194/378] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:23.109151 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8f304-327f-4965-b27e-12253e94459f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:23.134808 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0cae0-15b9-4667-a2cb-66c20a19d382 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:23.139683 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:23.188118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24f42-eb75-4b17-b03b-4e20605b09ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:23.189797 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24f42-eb75-4b17-b03b-4e20605b09ef None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.190375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24f42-eb75-4b17-b03b-4e20605b09ef None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.191918 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24f42-eb75-4b17-b03b-4e20605b09ef None admin] PATH_INFO: `/v3/groups/273aad004a8249539bf58dcf3f18d3fa` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.198688 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c24f42-eb75-4b17-b03b-4e20605b09ef None admin] RBAC: Authorizing `identity:get_group(group_id=273aad004a8249539bf58dcf3f18d3fa)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:23.200421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c24f42-eb75-4b17-b03b-4e20605b09ef None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:23.202357 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 185/379] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:22 2022] GET /identity/v3/groups/273aad004a8249539bf58dcf3f18d3fa => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:23.203629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a5d3-54a8-47c7-96f2-69f1fdc270d3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.203929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a5d3-54a8-47c7-96f2-69f1fdc270d3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.204575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4a5d3-54a8-47c7-96f2-69f1fdc270d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.228586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7ad4a5d3-54a8-47c7-96f2-69f1fdc270d3 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:23.229828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7ad4a5d3-54a8-47c7-96f2-69f1fdc270d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:23.248643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8f304-327f-4965-b27e-12253e94459f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:23.287913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:23.289072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.289556 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.290047 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.291186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:23.291738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:23.294469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:23.299244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:23.303772 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 195/380] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:23 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=81307e0920ce427d9422f90d0da01275 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:23.304913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:23.315338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 186/381] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:23.344459 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4a5d3-54a8-47c7-96f2-69f1fdc270d3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:23.417474 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:23.441706 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df1403-1ff0-4365-81b2-ed81c3bdc46b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:23.497248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:23.498813 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.499347 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.499823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.500886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] RBAC: Adding query filter params (group.id=273aad004a8249539bf58dcf3f18d3fa, role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=460d90891ba54a98b3b62dfbf4e206e2) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:23.501487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:23.503236 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:23.511220 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 196/382] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:23 2022] GET /identity/v3/role_assignments?group.id=273aad004a8249539bf58dcf3f18d3fa&scope.project.id=460d90891ba54a98b3b62dfbf4e206e2&role.id=079434fe84194c03ae64e10d61e222e6 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:23.596687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4a5d3-54a8-47c7-96f2-69f1fdc270d3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:23.665203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca260-84b9-4fd7-91ad-436259536cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:23.665972 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca260-84b9-4fd7-91ad-436259536cd8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.666276 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca260-84b9-4fd7-91ad-436259536cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.666553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca260-84b9-4fd7-91ad-436259536cd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.684224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ca260-84b9-4fd7-91ad-436259536cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2e0ca260-84b9-4fd7-91ad-436259536cd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:23.692637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:23.693625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:23.694433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 187/383] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:23.701272 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:23.855358 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54af3-b687-4ac2-8e53-25c5c9c9afa8 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:23.893645 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c502-822b-438e-8d3b-a570ebc863de None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.893955 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c502-822b-438e-8d3b-a570ebc863de None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.894205 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329c502-822b-438e-8d3b-a570ebc863de None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.895897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 188/384] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:23.898949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:23.899660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.899938 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.900212 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.900966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:23.901276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:23.902847 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:23.903861 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4697d17-2795-4bb1-aa6a-957932601659 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:23.904155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4697d17-2795-4bb1-aa6a-957932601659 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:23.904396 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4697d17-2795-4bb1-aa6a-957932601659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:23.918495 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 197/385] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:23.925054 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:23.931707 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a4697d17-2795-4bb1-aa6a-957932601659 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:23.933280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a4697d17-2795-4bb1-aa6a-957932601659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:23.945335 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:24.006282 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:24.065301 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 189/386] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:24.067774 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7291-265e-4c8d-90fc-f74ccfae51be None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:24.089823 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4697d17-2795-4bb1-aa6a-957932601659 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:24.120971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:24.121802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:24.122502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:24.122502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:24.124292 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:24.125774 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:24.129309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 198/387] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:23 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:24.134773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:24.293121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:24.297667 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4697d17-2795-4bb1-aa6a-957932601659 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:24.324916 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013791-a75d-410e-8123-1d218e27fe1b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:24.344558 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:24.345647 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:24.345850 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:24.346143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:24.370466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:24.382933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:24.383874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:24.384674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:24.386958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:24.388739 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:24.389274 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:24.389754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:24.391182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:24.392881 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:24.394407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 190/388] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:24.396484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 199/389] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:24 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:24.400284 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:24.402254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:24.461506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:24.560151 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697305ec-cf23-446d-827b-f19f7579b9ca None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:24.577687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cff693-12ae-4253-86ed-2e8f95e53553 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:24.632793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:24.633767 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:24.633985 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:24.634257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:24.638426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=077c4e535ff6468b8dd7e3cb78766c74, group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:24.639943 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:24.649086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:24.649852 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:24.650118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:24.651635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:24.651635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:24.651635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:24.654283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:24.667615 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 191/390] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:24.672624 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 200/391] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 10:11:24 2022] PUT /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:11:24.674595 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:24.796876 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e592bd6-7495-4f0a-93a7-a25ed86369d9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:24.810293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:24.847367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:24.848279 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:24.848617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:24.848907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:24.850165 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:24.851739 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:24.853724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 192/392] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:24 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:24.859595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:24.863668 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:24.972254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46d624-5688-46d8-b529-1ce31c29c3d4 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:25.010168 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f54713-b9ba-441d-bd92-75974336396e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:25.011061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f54713-b9ba-441d-bd92-75974336396e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:25.011378 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f54713-b9ba-441d-bd92-75974336396e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:25.011718 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f54713-b9ba-441d-bd92-75974336396e None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:25.013193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f54713-b9ba-441d-bd92-75974336396e None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:25.014671 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f54713-b9ba-441d-bd92-75974336396e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:25.016852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 201/393] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:24 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:25.022758 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:25.150681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316765f3-bf90-4e4f-858f-a47d36ee8e1d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:25.187857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d596b2-dcc9-4670-9925-2922da01bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:25.189121 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d596b2-dcc9-4670-9925-2922da01bfd4 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:25.189405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d596b2-dcc9-4670-9925-2922da01bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:25.189683 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d596b2-dcc9-4670-9925-2922da01bfd4 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:25.191773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d596b2-dcc9-4670-9925-2922da01bfd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78f5cbfe8534463b2874b2b38757dd8, group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:25.193235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d596b2-dcc9-4670-9925-2922da01bfd4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:25.211757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 193/394] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 10:11:25 2022] PUT /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:25.333044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cb30d-018c-4b7a-a75e-9b3d0ebc9c1f None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:25.333663 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cb30d-018c-4b7a-a75e-9b3d0ebc9c1f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:25.334146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cb30d-018c-4b7a-a75e-9b3d0ebc9c1f None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:25.336022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 202/395] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:25.341793 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7867-3ad7-48f2-bc24-0665e9fc26af None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:25.342362 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7867-3ad7-48f2-bc24-0665e9fc26af None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:25.342833 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7867-3ad7-48f2-bc24-0665e9fc26af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:25.368419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a8cf7867-3ad7-48f2-bc24-0665e9fc26af None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:25.369990 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a8cf7867-3ad7-48f2-bc24-0665e9fc26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:25.406516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:25.457617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 194/396] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:25.498691 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cb30d-018c-4b7a-a75e-9b3d0ebc9c1f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:25.590671 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:25.629247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cb30d-018c-4b7a-a75e-9b3d0ebc9c1f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:25.668548 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:25.669387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:25.669671 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:25.669946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:25.680987 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:25.689617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:25.690514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:25.691746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 203/397] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:25.697858 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7867-3ad7-48f2-bc24-0665e9fc26af None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:25.852473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7867-3ad7-48f2-bc24-0665e9fc26af None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:25.891721 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:25.892804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:25.893280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:25.893745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:25.894745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:25.895247 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:25.896864 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:25.909217 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 195/398] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:25.915897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:26.022220 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66107fb-115e-4fc0-a379-57ffd9a34193 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:26.054152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:26.060464 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:26.061709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.062185 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.062699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.064526 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:26.066191 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:26.068465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 204/399] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:25 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:26.075786 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:26.113327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:26.211023 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a678df7-c7b0-461e-b04b-7fb5b0f5ba07 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:26.246851 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537fe5-14a6-47eb-b763-1ae23070e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:26.248162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537fe5-14a6-47eb-b763-1ae23070e782 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.248636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537fe5-14a6-47eb-b763-1ae23070e782 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.249097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537fe5-14a6-47eb-b763-1ae23070e782 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.250540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44537fe5-14a6-47eb-b763-1ae23070e782 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:26.252266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44537fe5-14a6-47eb-b763-1ae23070e782 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:26.254615 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 196/400] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:26 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:26.260137 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:26.376829 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c637f3-79a2-4ad7-91c0-61d7114ce1b2 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:26.412511 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5969f00-4d07-4095-a77b-6a61a3b20abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:26.413785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5969f00-4d07-4095-a77b-6a61a3b20abe None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.414257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5969f00-4d07-4095-a77b-6a61a3b20abe None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.414716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5969f00-4d07-4095-a77b-6a61a3b20abe None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/81307e0920ce427d9422f90d0da01275` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.417259 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5969f00-4d07-4095-a77b-6a61a3b20abe None admin] RBAC: Authorizing `identity:create_grant(project_id=077c4e535ff6468b8dd7e3cb78766c74, group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role_id=81307e0920ce427d9422f90d0da01275)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:26.418956 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5969f00-4d07-4095-a77b-6a61a3b20abe None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:26.440891 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 205/401] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 10:11:26 2022] PUT /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/81307e0920ce427d9422f90d0da01275 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:11:26.519389 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b87c-be27-4e78-858b-efaeaeef2cbf None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.520238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b87c-be27-4e78-858b-efaeaeef2cbf None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.520761 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7b87c-be27-4e78-858b-efaeaeef2cbf None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.522914 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 197/402] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:26.528805 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621558dd-ffc0-4c54-ae3e-540150f10042 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.529440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621558dd-ffc0-4c54-ae3e-540150f10042 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.529937 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621558dd-ffc0-4c54-ae3e-540150f10042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.550404 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-621558dd-ffc0-4c54-ae3e-540150f10042 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:26.552133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-621558dd-ffc0-4c54-ae3e-540150f10042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:26.628680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:26.638757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 206/403] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:26.664422 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7b87c-be27-4e78-858b-efaeaeef2cbf None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:26.774394 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:26.786988 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7b87c-be27-4e78-858b-efaeaeef2cbf None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:26.836196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb68b-4ccd-4109-8b0b-a8b31d4be913 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.836768 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb68b-4ccd-4109-8b0b-a8b31d4be913 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.837247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb68b-4ccd-4109-8b0b-a8b31d4be913 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.839079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 207/404] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:26.844659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e7d0-915d-4f8a-8f61-b145fdf227c8 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.845349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e7d0-915d-4f8a-8f61-b145fdf227c8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.846074 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0e7d0-915d-4f8a-8f61-b145fdf227c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.854759 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:26.855668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:26.856009 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:26.856335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:26.866482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-71c0e7d0-915d-4f8a-8f61-b145fdf227c8 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:26.868365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-71c0e7d0-915d-4f8a-8f61-b145fdf227c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:26.871534 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:26.881863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:26.882810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:26.883668 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:26.886112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 198/405] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:26.889002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:26.951010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 208/406] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:26.978235 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e7d0-915d-4f8a-8f61-b145fdf227c8 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.087135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65627359-9803-42f7-87a5-e034d91889f5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.094813 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0e7d0-915d-4f8a-8f61-b145fdf227c8 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.127824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:27.131663 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.132486 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.132818 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.133093 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.145284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:27.153666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:27.154582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:27.155408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 209/407] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:11:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:27.164198 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.165142 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.166060 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.166544 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.167018 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.168159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:27.168799 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:27.170469 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:27.180363 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 199/408] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:27.189737 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.224884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:27.292727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ed0d-dae5-4c49-abc2-b5098a600386 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.359913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.360700 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.361036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.361315 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.362072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:27.362377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:27.363802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:27.379734 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 210/409] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:27.384808 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc49d4-a22d-4409-94e2-f49fac509130 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.387978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.440968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:27.480043 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.481059 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.481582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.481897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.488011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:27.489506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:27.491520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 200/410] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:27 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:27.496044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105df5d9-0a82-4559-b9be-db5cd817c32e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.498090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.538075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.538961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.539241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.539537 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] PATH_INFO: `/v3/groups/273aad004a8249539bf58dcf3f18d3fa` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.540935 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] RBAC: Authorizing `identity:get_group(group_id=273aad004a8249539bf58dcf3f18d3fa)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:27.542388 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:27.544098 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 211/411] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:27 2022] GET /identity/v3/groups/273aad004a8249539bf58dcf3f18d3fa => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:27.551246 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.666314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:27.693825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b048ac-05f1-44ac-8c54-d71fa2110fd2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.709226 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074fda1-832c-4f94-bb42-946d37ed361f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.721043 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:27.745725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.747265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.747867 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.748343 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] PATH_INFO: `/v3/projects/460d90891ba54a98b3b62dfbf4e206e2` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.749718 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] RBAC: Authorizing `identity:get_project(project_id=460d90891ba54a98b3b62dfbf4e206e2)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:27.751413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:27.753726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 212/412] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:27 2022] GET /identity/v3/projects/460d90891ba54a98b3b62dfbf4e206e2 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:27.758876 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.765034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.765930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.766210 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.766480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.772005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:27.773477 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:27.775628 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 201/413] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:27 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:27.781465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:27.878081 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b394c4-008b-422e-9e70-856b623a3e49 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.917416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f46420-eb13-4e96-abbd-d079910cf8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:27.919201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46420-eb13-4e96-abbd-d079910cf8cc None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.919714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46420-eb13-4e96-abbd-d079910cf8cc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.920176 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f46420-eb13-4e96-abbd-d079910cf8cc None admin] PATH_INFO: `/v3/projects/460d90891ba54a98b3b62dfbf4e206e2/groups/273aad004a8249539bf58dcf3f18d3fa/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.923363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46420-eb13-4e96-abbd-d079910cf8cc None admin] RBAC: Authorizing `identity:create_grant(project_id=460d90891ba54a98b3b62dfbf4e206e2, group_id=273aad004a8249539bf58dcf3f18d3fa, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:27.926020 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f46420-eb13-4e96-abbd-d079910cf8cc None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:27.934619 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c4b4-951f-4fd0-a612-1d9c8f3fb54f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:27.947410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 213/414] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 10:11:27 2022] PUT /identity/v3/projects/460d90891ba54a98b3b62dfbf4e206e2/groups/273aad004a8249539bf58dcf3f18d3fa/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:11:27.949127 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f4260-1592-47c7-9b24-11da0655b2f5 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.949693 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f4260-1592-47c7-9b24-11da0655b2f5 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.950165 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f4260-1592-47c7-9b24-11da0655b2f5 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.952353 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 214/415] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:27.959587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c09f-b137-41b2-9936-fc7c83668c9f None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:27.959587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c09f-b137-41b2-9936-fc7c83668c9f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:27.959587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361c09f-b137-41b2-9936-fc7c83668c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:27.993277 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-6361c09f-b137-41b2-9936-fc7c83668c9f None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:27.998075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-6361c09f-b137-41b2-9936-fc7c83668c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:28.017629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:28.018654 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:28.018943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:28.019221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/81307e0920ce427d9422f90d0da01275` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:28.023776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] RBAC: Authorizing `identity:create_grant(project_id=b78f5cbfe8534463b2874b2b38757dd8, group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role_id=81307e0920ce427d9422f90d0da01275)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:28.025282 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:28.057269 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 202/416] 10.222.0.67 () {58 vars in 1442 bytes} [Wed May 25 10:11:27 2022] PUT /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7/roles/81307e0920ce427d9422f90d0da01275 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:11:28.065278 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:28.110366 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 215/417] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:28.151262 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:28.168523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:28.279374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d5b6a-76a4-4202-8266-6c469f5e3303 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:28.322254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ea898-0fbc-42b0-8bb6-0dcb6b64f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:28.323140 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea898-0fbc-42b0-8bb6-0dcb6b64f8ed None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:28.323466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea898-0fbc-42b0-8bb6-0dcb6b64f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:28.323799 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ea898-0fbc-42b0-8bb6-0dcb6b64f8ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:28.335694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ea898-0fbc-42b0-8bb6-0dcb6b64f8ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-986ea898-0fbc-42b0-8bb6-0dcb6b64f8ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:28.344192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:28.345126 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:28.346116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 203/418] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:28.351849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c09f-b137-41b2-9936-fc7c83668c9f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:28.475832 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361c09f-b137-41b2-9936-fc7c83668c9f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:28.503958 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4bdf-d346-490e-a4ac-181826457738 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:28.504273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4bdf-d346-490e-a4ac-181826457738 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:28.504519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4bdf-d346-490e-a4ac-181826457738 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:28.506072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 204/419] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:28.511568 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76113b-6b9e-42f5-a5f1-c71942026deb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:28.511859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76113b-6b9e-42f5-a5f1-c71942026deb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:28.512437 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76113b-6b9e-42f5-a5f1-c71942026deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:28.529554 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-de76113b-6b9e-42f5-a5f1-c71942026deb None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:28.530750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-de76113b-6b9e-42f5-a5f1-c71942026deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:28.546445 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:28.547132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:28.547442 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:28.547710 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:28.548470 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] RBAC: Adding query filter params (name=member) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:28.548771 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:28.550176 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:28.573899 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 216/420] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:28.585523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:28.643429 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:28.650317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 205/421] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:28.692002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76113b-6b9e-42f5-a5f1-c71942026deb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:28.695592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:28.769288 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d97874-25c0-47be-9605-741a72117b33 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:28.802416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76113b-6b9e-42f5-a5f1-c71942026deb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:28.838456 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:28.839304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:28.839581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:28.839849 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:28.852706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:28.859371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:28.860249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:28.861457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 206/422] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:28.866724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:28.873119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9eea0d-421a-42ac-a127-8bdbb487e3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:28.874082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eea0d-421a-42ac-a127-8bdbb487e3b1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:28.874562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eea0d-421a-42ac-a127-8bdbb487e3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:28.875022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eea0d-421a-42ac-a127-8bdbb487e3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:28.945329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:28.970452 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839655c2-f5ab-4075-9b36-eb45382ba8b9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.004352 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.005033 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.005314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.005590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.006344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] RBAC: Adding query filter params (name=member) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:29.006650 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.008091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.017455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 207/423] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:11:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:29.022848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.077699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9eea0d-421a-42ac-a127-8bdbb487e3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.079184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9eea0d-421a-42ac-a127-8bdbb487e3b1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.126364 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc686aa-91d4-4a5a-9f92-98462a17539b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.163312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.164011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.164292 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.164565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.168944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:29.192695 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:29.234493 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.236109 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.334895 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 208/424] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:29.340469 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.369213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:29.430694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 217/425] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:29.432094 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7689bc-110b-44ad-9b67-ca732d5070e9 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.432384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7689bc-110b-44ad-9b67-ca732d5070e9 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.432661 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7689bc-110b-44ad-9b67-ca732d5070e9 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.439061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 218/426] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:29.439873 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7689bc-110b-44ad-9b67-ca732d5070e9 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.456720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffbc42-adb9-4fcc-99f6-2f26592098ca None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.505904 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9d278-59cb-48fb-b2fa-3dd1d16c69d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.507454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d278-59cb-48fb-b2fa-3dd1d16c69d1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.507949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d278-59cb-48fb-b2fa-3dd1d16c69d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.508519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9d278-59cb-48fb-b2fa-3dd1d16c69d1 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.510482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9d278-59cb-48fb-b2fa-3dd1d16c69d1 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.512682 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9d278-59cb-48fb-b2fa-3dd1d16c69d1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.515377 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 209/427] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:29.516788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f271-4744-47e6-bea1-3eec60d8d23b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.517241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f271-4744-47e6-bea1-3eec60d8d23b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.517684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691f271-4744-47e6-bea1-3eec60d8d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.535036 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d691f271-4744-47e6-bea1-3eec60d8d23b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:29.536575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d691f271-4744-47e6-bea1-3eec60d8d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:29.562198 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7689bc-110b-44ad-9b67-ca732d5070e9 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.595843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:29.601018 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.602001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.602277 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.602549 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.604217 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.605918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.608320 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 219/428] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:29.612811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.613590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 210/429] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:29.614630 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691f271-4744-47e6-bea1-3eec60d8d23b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.659406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:29.736176 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998cf63-e4b3-4ef8-b7ac-3d0a2db6adac None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.759985 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691f271-4744-47e6-bea1-3eec60d8d23b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.782949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.784502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.785464 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.785953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.787866 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.790193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.793342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 220/430] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:29.794456 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.808263 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.809176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.809466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.809747 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.811541 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.813256 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.820454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 211/431] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:29.820454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.872496 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:29.907895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7c45-a56d-48fa-ad10-c22f20beb05e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.923584 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:29.935788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24baefc-dc6d-4dd9-ba65-36cf1f397483 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:29.943984 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.944814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.945105 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.945398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.956381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:29.965728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:29.966638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:29.967432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:29.971693 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 221/432] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:29.972720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:29.977478 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:29.978358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:29.978810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:29.979250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:29.980305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:29.980898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:29.982646 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:29.989705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 212/433] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:29.990834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:30.100556 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b73a3-fb27-400f-81b9-193e9b5e3504 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:30.107027 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc883d5f-e9ba-49dc-9a0a-3b60d7a44552 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:30.146995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:30.148054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.148547 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.149036 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.150007 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:30.150538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:30.152343 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:30.158669 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:30.164075 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 213/434] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:30.176000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:30.178875 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:30.179789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.180170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.180546 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.181926 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=8b6c1d1fbb554fcab560889bed4612cc, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:30.181926 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:30.183553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:30.195305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 222/435] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:29 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=8b6c1d1fbb554fcab560889bed4612cc => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:30.203500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:30.319957 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372d6d9-f196-493b-8466-88105a49e8fe None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:30.363102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1469-199d-4604-9898-bcccff40ad66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:30.363820 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1469-199d-4604-9898-bcccff40ad66 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.364111 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1469-199d-4604-9898-bcccff40ad66 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.364393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1469-199d-4604-9898-bcccff40ad66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.445886 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1469-199d-4604-9898-bcccff40ad66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:30.447435 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1469-199d-4604-9898-bcccff40ad66 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:30.468955 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:30.564896 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 214/436] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:30.570748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:30.681270 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7c8b-2b31-4b86-9a79-693a43f75367 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.681572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7c8b-2b31-4b86-9a79-693a43f75367 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.681855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a7c8b-2b31-4b86-9a79-693a43f75367 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.683241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 215/437] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:30.684960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849e0ed-df44-4365-b163-7ba450f8bd5c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:30.688965 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a03ce-9990-4352-8d4a-04ad8e5ac765 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.689260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a03ce-9990-4352-8d4a-04ad8e5ac765 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.689541 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a03ce-9990-4352-8d4a-04ad8e5ac765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.708237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9f8a03ce-9990-4352-8d4a-04ad8e5ac765 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:30.710672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9f8a03ce-9990-4352-8d4a-04ad8e5ac765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:30.724881 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:30.726304 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.726684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.726972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] PATH_INFO: `/v3/projects/077c4e535ff6468b8dd7e3cb78766c74` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.728233 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=077c4e535ff6468b8dd7e3cb78766c74)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:30.729822 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:30.732168 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 223/438] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:30 2022] GET /identity/v3/projects/077c4e535ff6468b8dd7e3cb78766c74 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:30.737528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:30.794176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 216/439] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:30.807227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2afa-bd54-4a34-b6be-f3f19ba430c2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.807634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2afa-bd54-4a34-b6be-f3f19ba430c2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.807827 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2afa-bd54-4a34-b6be-f3f19ba430c2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.808806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:30.809532 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 217/440] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:30.815117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c9c0f-4be7-474a-ac3a-c675b48f9419 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.815444 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c9c0f-4be7-474a-ac3a-c675b48f9419 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.815722 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c9c0f-4be7-474a-ac3a-c675b48f9419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.832865 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f47c9c0f-4be7-474a-ac3a-c675b48f9419 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:30.834059 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f47c9c0f-4be7-474a-ac3a-c675b48f9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:30.857154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ce9d-5639-4d07-897b-0bd853237cb8 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:30.874694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:30.893178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:30.894050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:30.894337 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:30.894614 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:30.895833 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:30.897287 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:30.898924 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 224/441] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:30 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:30.899724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:30.902227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 218/442] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:30.905236 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c9c0f-4be7-474a-ac3a-c675b48f9419 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:30.999975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87189fb1-58db-41a0-b87b-764ce57006ff None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.004435 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c9c0f-4be7-474a-ac3a-c675b48f9419 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.024157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.033259 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.034110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.034395 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.034673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.037275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.037929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.038208 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.038482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.039330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=077c4e535ff6468b8dd7e3cb78766c74) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:31.039646 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.041102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.044732 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:31.047050 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 219/443] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:30 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=077c4e535ff6468b8dd7e3cb78766c74&role.id=81307e0920ce427d9422f90d0da01275 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:31.047936 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:31.057421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:31.058523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:31.060017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 225/444] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:11:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:31.065217 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.102168 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.167299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f7da6-4d3e-448d-b139-43f3e92f6126 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.185533 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ffeaa-056c-4012-8582-5bb174aa5f68 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.205012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05846648-862c-41f9-93ab-15820867b19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.206206 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846648-862c-41f9-93ab-15820867b19e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.206715 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846648-862c-41f9-93ab-15820867b19e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.207179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05846648-862c-41f9-93ab-15820867b19e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.219191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05846648-862c-41f9-93ab-15820867b19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:31.223394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.224094 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.224380 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.224660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.225418 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:31.225729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-05846648-862c-41f9-93ab-15820867b19e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:31.227054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:31.228071 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:31.228859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:31.229460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.233537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 220/445] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:31.234452 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05846648-862c-41f9-93ab-15820867b19e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.239237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 226/446] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:31.244660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.310219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.349232 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.354966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05846648-862c-41f9-93ab-15820867b19e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.373577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580288-66c9-4f5c-b4db-ab40a8307b76 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.398398 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.400058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.400058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.400058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.400824 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:31.400824 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.402225 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.413581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 221/447] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:31.418026 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.418594 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.418880 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.419156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.419376 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.497972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.499613 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.535178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e486ce6-8ef5-42ff-9138-1b813d340b61 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.560805 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.580221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.580890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.581177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.581450 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.617683 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.623025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 227/448] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:31.628617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.655821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.657359 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.724203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5a4fc-7acb-44b9-8e71-2dd4129d9432 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.754952 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 222/449] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:31.756777 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.757654 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.757938 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.758217 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] PATH_INFO: `/v3/projects/b78f5cbfe8534463b2874b2b38757dd8` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.759447 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] RBAC: Authorizing `identity:get_project(project_id=b78f5cbfe8534463b2874b2b38757dd8)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.760650 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.760922 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.767061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 228/450] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/projects/b78f5cbfe8534463b2874b2b38757dd8 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:31.767882 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.785723 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.825726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:31.866134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f135d7a-38d1-4c2f-9fd1-53e3bd038c55 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.867500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae620b8-7b64-4938-b0c1-47c3a730b532 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:31.900330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.901201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.901488 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.901765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] PATH_INFO: `/v3/projects/460d90891ba54a98b3b62dfbf4e206e2` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.903925 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:31.904067 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] RBAC: Authorizing `identity:get_project(project_id=460d90891ba54a98b3b62dfbf4e206e2)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.904800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:31.905086 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:31.905362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] PATH_INFO: `/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:31.905456 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.906548 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] RBAC: Authorizing `identity:get_group(group_id=c8e3ae4912a642f7a8dc6a0d1a5475b7)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:31.907141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 223/451] 10.222.0.67 () {56 vars in 1186 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/projects/460d90891ba54a98b3b62dfbf4e206e2 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:31.908017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:31.909646 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 229/452] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/groups/c8e3ae4912a642f7a8dc6a0d1a5475b7 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:31.912674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:31.915303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:32.000370 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:32.010060 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb049c-7af4-4b67-8048-0247f2690024 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:32.018049 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5228d6-9e3d-4528-99db-7cbf27747c95 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:32.039080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:32.045445 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:32.046308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:32.046588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:32.046861 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] PATH_INFO: `/v3/groups/273aad004a8249539bf58dcf3f18d3fa` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:32.048059 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] RBAC: Authorizing `identity:get_group(group_id=273aad004a8249539bf58dcf3f18d3fa)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:32.049515 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:32.051133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 224/453] 10.222.0.67 () {56 vars in 1180 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/groups/273aad004a8249539bf58dcf3f18d3fa => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:32.052845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f94a4-dd9e-436b-bdac-9ad95358a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:32.053515 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f94a4-dd9e-436b-bdac-9ad95358a12a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:32.053800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f94a4-dd9e-436b-bdac-9ad95358a12a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:32.054075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f94a4-dd9e-436b-bdac-9ad95358a12a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:32.054949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f94a4-dd9e-436b-bdac-9ad95358a12a None admin] RBAC: Adding query filter params (group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7, role.id=81307e0920ce427d9422f90d0da01275, scope.project.id=b78f5cbfe8534463b2874b2b38757dd8) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:32.055261 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f94a4-dd9e-436b-bdac-9ad95358a12a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:32.056733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f94a4-dd9e-436b-bdac-9ad95358a12a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:32.056902 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:32.073397 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 230/454] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:31 2022] GET /identity/v3/role_assignments?group.id=c8e3ae4912a642f7a8dc6a0d1a5475b7&scope.project.id=b78f5cbfe8534463b2874b2b38757dd8&role.id=81307e0920ce427d9422f90d0da01275 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:32.172801 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f8538-fd3b-4c45-866e-eaccc05423b3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:32.212579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816e83b-64c9-4db3-bb76-9d487907ca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:32.213540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e83b-64c9-4db3-bb76-9d487907ca98 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:32.213961 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e83b-64c9-4db3-bb76-9d487907ca98 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:32.214374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816e83b-64c9-4db3-bb76-9d487907ca98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:32.215432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e83b-64c9-4db3-bb76-9d487907ca98 None admin] RBAC: Adding query filter params (group.id=273aad004a8249539bf58dcf3f18d3fa, role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=460d90891ba54a98b3b62dfbf4e206e2) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:32.215927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e83b-64c9-4db3-bb76-9d487907ca98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:32.217654 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816e83b-64c9-4db3-bb76-9d487907ca98 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:32.230070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 225/455] 10.222.0.67 () {56 vars in 1376 bytes} [Wed May 25 10:11:32 2022] GET /identity/v3/role_assignments?group.id=273aad004a8249539bf58dcf3f18d3fa&scope.project.id=460d90891ba54a98b3b62dfbf4e206e2&role.id=079434fe84194c03ae64e10d61e222e6 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:34.937743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5619b-b5b6-40ec-a9ab-6fe878b4a4d7 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:34.937743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5619b-b5b6-40ec-a9ab-6fe878b4a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:34.937743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5619b-b5b6-40ec-a9ab-6fe878b4a4d7 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:34.939027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 231/456] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:34.944749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36fdd-d26d-4c99-aa42-124be3dadd0e None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:34.945561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36fdd-d26d-4c99-aa42-124be3dadd0e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:34.946127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee36fdd-d26d-4c99-aa42-124be3dadd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:34.964468 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-6ee36fdd-d26d-4c99-aa42-124be3dadd0e None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:34.967437 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6ee36fdd-d26d-4c99-aa42-124be3dadd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:35.002628 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed00b-c32c-4fde-9d39-0d01c73c6d55 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.002902 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed00b-c32c-4fde-9d39-0d01c73c6d55 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.003479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed00b-c32c-4fde-9d39-0d01c73c6d55 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.005345 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 232/457] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:35.011597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779971a-999f-4d3c-9aad-c95dedba4d65 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.012300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779971a-999f-4d3c-9aad-c95dedba4d65 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.012770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779971a-999f-4d3c-9aad-c95dedba4d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.033124 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-c779971a-999f-4d3c-9aad-c95dedba4d65 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:35.034946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-c779971a-999f-4d3c-9aad-c95dedba4d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:35.036322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:35.048776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 226/458] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:35.077694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36fdd-d26d-4c99-aa42-124be3dadd0e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.111402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 233/459] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:35.143039 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779971a-999f-4d3c-9aad-c95dedba4d65 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.188863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee36fdd-d26d-4c99-aa42-124be3dadd0e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:35.226653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80277395-4a37-43ce-8de9-98989a097c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:35.227487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80277395-4a37-43ce-8de9-98989a097c4b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.227825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80277395-4a37-43ce-8de9-98989a097c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.228113 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80277395-4a37-43ce-8de9-98989a097c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.239055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80277395-4a37-43ce-8de9-98989a097c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:35.240851 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80277395-4a37-43ce-8de9-98989a097c4b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:35.244417 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-80277395-4a37-43ce-8de9-98989a097c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:35.262080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:35.263164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:35.264480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:35.264480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:35.264480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:35.264480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:35.264480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 227/460] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:35.265142 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c60c1-7feb-4cb7-bd03-8f7eb394a972 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.265432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c60c1-7feb-4cb7-bd03-8f7eb394a972 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.265712 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c60c1-7feb-4cb7-bd03-8f7eb394a972 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.267266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 228/461] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:35.272361 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c60c1-7feb-4cb7-bd03-8f7eb394a972 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.279605 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779971a-999f-4d3c-9aad-c95dedba4d65 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:35.317653 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f805928-904f-4c08-98c6-cb57f720d5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:35.318558 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805928-904f-4c08-98c6-cb57f720d5a3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.318848 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805928-904f-4c08-98c6-cb57f720d5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.319126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f805928-904f-4c08-98c6-cb57f720d5a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.330036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805928-904f-4c08-98c6-cb57f720d5a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:35.331479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f805928-904f-4c08-98c6-cb57f720d5a3 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:35.332539 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-4f805928-904f-4c08-98c6-cb57f720d5a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:35.350216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:35.351111 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:35.352222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:35.352222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:35.352222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:35.352222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:35.352222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 234/462] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:35.353085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d977d-2533-487d-8099-5cf3023aae31 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.353362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d977d-2533-487d-8099-5cf3023aae31 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.353633 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d977d-2533-487d-8099-5cf3023aae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.370232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-8e3d977d-2533-487d-8099-5cf3023aae31 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:35.371580 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-8e3d977d-2533-487d-8099-5cf3023aae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:35.409705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c60c1-7feb-4cb7-bd03-8f7eb394a972 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:35.447199 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 235/463] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:35.452273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b1184-baf8-47c4-9a0e-96098748bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:35.452273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b1184-baf8-47c4-9a0e-96098748bdba None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.452273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b1184-baf8-47c4-9a0e-96098748bdba None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.452273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b1184-baf8-47c4-9a0e-96098748bdba None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.452598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b1184-baf8-47c4-9a0e-96098748bdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:35.452598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b1184-baf8-47c4-9a0e-96098748bdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:35.452714 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b1184-baf8-47c4-9a0e-96098748bdba None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:35.456023 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d977d-2533-487d-8099-5cf3023aae31 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.465924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 229/464] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:35.467153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f429-e10d-4545-85f9-375a2db3f0fc None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.467487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f429-e10d-4545-85f9-375a2db3f0fc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.467767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f429-e10d-4545-85f9-375a2db3f0fc None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.469116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 230/465] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:35.473697 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f429-e10d-4545-85f9-375a2db3f0fc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.521905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:35.565313 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d977d-2533-487d-8099-5cf3023aae31 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:35.579019 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f429-e10d-4545-85f9-375a2db3f0fc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:35.582932 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:35.600912 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8ed3b-2925-47d8-b6d2-04e749c9e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:35.601586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8ed3b-2925-47d8-b6d2-04e749c9e33a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.601868 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8ed3b-2925-47d8-b6d2-04e749c9e33a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.602144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8ed3b-2925-47d8-b6d2-04e749c9e33a None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.602874 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8ed3b-2925-47d8-b6d2-04e749c9e33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:35.603178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8ed3b-2925-47d8-b6d2-04e749c9e33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:35.604605 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8ed3b-2925-47d8-b6d2-04e749c9e33a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:35.616341 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 236/466] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:35.616464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:35.617025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.617309 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.617522 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632c3f-5362-4f6e-b6c5-2ff55bd46228 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.617654 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.617818 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632c3f-5362-4f6e-b6c5-2ff55bd46228 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.618078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41632c3f-5362-4f6e-b6c5-2ff55bd46228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.618350 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:35.619817 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:35.635625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-41632c3f-5362-4f6e-b6c5-2ff55bd46228 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:35.637053 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-41632c3f-5362-4f6e-b6c5-2ff55bd46228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:35.656890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 231/467] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:11:35 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:35.656890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.715807 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 237/468] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:35.724349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632c3f-5362-4f6e-b6c5-2ff55bd46228 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.780740 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d2a4-a1a2-4162-ab52-4e2a4c9f543e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:35.796932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:35.821638 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:35.822584 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.822947 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.823315 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.835598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:35.837024 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:35.856371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:35.857242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:35.858486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:35.858486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:35.858486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:35.858486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:35.858486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 232/469] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:35.858486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.862027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41632c3f-5362-4f6e-b6c5-2ff55bd46228 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:35.875453 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:35.904120 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:35.904816 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:35.905100 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:35.905373 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:35.906082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:35.907608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:35.928679 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 238/470] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:11:35 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:35.929351 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:35.978589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2630d-2bca-4f91-8014-94e5d4f6e906 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:36.020353 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:36.021369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:36.021770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:36.022246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:36.035528 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:36.036562 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:36.058096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3450fe-0ecc-4260-a8f9-729354577f1c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:36.060579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:36.061436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:36.062280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:36.062280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:36.062280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:36.062280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:36.062498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 233/471] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:36.068217 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:36.070161 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:36.109795 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:36.112135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:36.112630 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:36.113055 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:36.114049 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:36.114533 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:36.116185 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:36.134754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 239/472] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:36.140588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:36.144865 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:36.200264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07617628-5660-4cb5-be19-2f90e484ea3c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:36.246450 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:36.247237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:36.247554 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:36.247834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:36.248579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:36.248892 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:36.250320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:36.262780 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 234/473] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:36.267766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:36.278694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e8010-4a7c-4627-a2c2-20a2c9b88550 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:36.314509 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9321488-67ad-4b31-82c7-94926ad06409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:36.315191 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321488-67ad-4b31-82c7-94926ad06409 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:36.315503 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321488-67ad-4b31-82c7-94926ad06409 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:36.315773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9321488-67ad-4b31-82c7-94926ad06409 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:36.316523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321488-67ad-4b31-82c7-94926ad06409 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:36.317996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9321488-67ad-4b31-82c7-94926ad06409 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:36.343393 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 240/474] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:11:36 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:36.398558 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451017f2-50ad-46a6-a9e2-7c8d3fee3515 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:36.426764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:36.440863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230c958-9518-4592-864b-f6967b3f5d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:36.441652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c958-9518-4592-864b-f6967b3f5d1b None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:36.441938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c958-9518-4592-864b-f6967b3f5d1b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:36.442215 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c958-9518-4592-864b-f6967b3f5d1b None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:36.442937 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230c958-9518-4592-864b-f6967b3f5d1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:36.444499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230c958-9518-4592-864b-f6967b3f5d1b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:36.472776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 235/475] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:11:36 2022] POST /identity/v3/users => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:11:38.067750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd5d99-1aa5-4cca-86df-7fa95250240c None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.068270 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd5d99-1aa5-4cca-86df-7fa95250240c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.068342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd5d99-1aa5-4cca-86df-7fa95250240c None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.069906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 241/476] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:38.075603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c280f-0b10-408d-8d6e-2e6b548c8fcc None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.075996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c280f-0b10-408d-8d6e-2e6b548c8fcc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.076135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c280f-0b10-408d-8d6e-2e6b548c8fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.094300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-519c280f-0b10-408d-8d6e-2e6b548c8fcc None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:38.095555 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-519c280f-0b10-408d-8d6e-2e6b548c8fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:38.167439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 236/477] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:38.193610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd5d99-1aa5-4cca-86df-7fa95250240c None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:38.220885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:38.309584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd5d99-1aa5-4cca-86df-7fa95250240c None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:38.347135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77f0f2-c0e7-4fa8-8961-e1b542d3d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:38.347902 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f0f2-c0e7-4fa8-8961-e1b542d3d954 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.348189 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f0f2-c0e7-4fa8-8961-e1b542d3d954 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.348466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77f0f2-c0e7-4fa8-8961-e1b542d3d954 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.360205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77f0f2-c0e7-4fa8-8961-e1b542d3d954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-7a77f0f2-c0e7-4fa8-8961-e1b542d3d954 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:38.369369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:38.370222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:38.371241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 242/478] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:38.376649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c280f-0b10-408d-8d6e-2e6b548c8fcc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:38.422357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103a8d-f7b8-4128-8c88-c139d6f189c8 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.423011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103a8d-f7b8-4128-8c88-c139d6f189c8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.423618 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103a8d-f7b8-4128-8c88-c139d6f189c8 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.425536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 243/479] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:38.430916 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278f466-9f61-486f-a99e-53542ba3c140 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.431500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278f466-9f61-486f-a99e-53542ba3c140 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.431979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278f466-9f61-486f-a99e-53542ba3c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.452055 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-c278f466-9f61-486f-a99e-53542ba3c140 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:38.454267 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-c278f466-9f61-486f-a99e-53542ba3c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:38.479625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c280f-0b10-408d-8d6e-2e6b548c8fcc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:38.492936 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:38.531926 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:38.533032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.533464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.534202 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.535400 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:38.535855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:38.538184 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:38.545362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 244/480] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:38.553480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 237/481] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:38.560894 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278f466-9f61-486f-a99e-53542ba3c140 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:38.573565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:38.579220 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:38.670402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278f466-9f61-486f-a99e-53542ba3c140 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:38.686148 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb241b-3ffc-431f-a327-35e2143c2886 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:38.709021 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4113ab-e141-4f02-b77d-e43498ab91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:38.709988 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4113ab-e141-4f02-b77d-e43498ab91e5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.710268 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4113ab-e141-4f02-b77d-e43498ab91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.710722 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4113ab-e141-4f02-b77d-e43498ab91e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.723150 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4113ab-e141-4f02-b77d-e43498ab91e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:38.724601 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:38.724723 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4113ab-e141-4f02-b77d-e43498ab91e5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:38.725427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.725705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.725975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.737337 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-0d4113ab-e141-4f02-b77d-e43498ab91e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:38.743959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:38.744905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:38.745733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:38.745733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:38.745733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:38.745733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:38.745949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:38.746800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:38.748789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:38.750615 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 245/482] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:38.751957 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 238/483] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:38.753099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55186c-71b9-4e00-8281-9d836c1c2f8f None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.753099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55186c-71b9-4e00-8281-9d836c1c2f8f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.753285 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:38.753366 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55186c-71b9-4e00-8281-9d836c1c2f8f None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.754218 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 246/484] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:38.755436 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55186c-71b9-4e00-8281-9d836c1c2f8f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:38.788972 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:38.829810 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:38.872205 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe1437-c80c-4265-a625-95b18b70730b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:38.875521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55186c-71b9-4e00-8281-9d836c1c2f8f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:38.908321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950909a-da97-4432-b79b-37b550385319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:38.908987 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950909a-da97-4432-b79b-37b550385319 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.909266 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950909a-da97-4432-b79b-37b550385319 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.909537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950909a-da97-4432-b79b-37b550385319 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.910264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950909a-da97-4432-b79b-37b550385319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:38.910575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950909a-da97-4432-b79b-37b550385319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:38.912030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950909a-da97-4432-b79b-37b550385319 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:38.912132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9049c-8769-4c01-87d2-a89e1d721804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:38.912712 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9049c-8769-4c01-87d2-a89e1d721804 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.912991 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9049c-8769-4c01-87d2-a89e1d721804 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.913382 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9049c-8769-4c01-87d2-a89e1d721804 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.913990 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9049c-8769-4c01-87d2-a89e1d721804 None admin] RBAC: Adding query filter params (name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:38.914299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9049c-8769-4c01-87d2-a89e1d721804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:38.915744 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9049c-8769-4c01-87d2-a89e1d721804 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:38.928987 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 239/485] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:38.929187 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 247/486] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:38.929281 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affa4a6-9de7-4204-9d93-d2cd1a661591 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.929281 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affa4a6-9de7-4204-9d93-d2cd1a661591 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.929428 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526767-c08b-4607-8021-3584319cabca None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:38.929506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affa4a6-9de7-4204-9d93-d2cd1a661591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.929593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526767-c08b-4607-8021-3584319cabca None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:38.929593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e526767-c08b-4607-8021-3584319cabca None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:38.929593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 248/487] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:38.930831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526767-c08b-4607-8021-3584319cabca None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:38.944924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0affa4a6-9de7-4204-9d93-d2cd1a661591 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:38.946140 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0affa4a6-9de7-4204-9d93-d2cd1a661591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:39.008853 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 240/488] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:39.009690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affa4a6-9de7-4204-9d93-d2cd1a661591 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.043351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.044806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e526767-c08b-4607-8021-3584319cabca None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.070605 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.080442 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42790d4-d093-487f-bd80-456d18142ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.081248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42790d4-d093-487f-bd80-456d18142ac0 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.081525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42790d4-d093-487f-bd80-456d18142ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.081799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42790d4-d093-487f-bd80-456d18142ac0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.089169 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42790d4-d093-487f-bd80-456d18142ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.091265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42790d4-d093-487f-bd80-456d18142ac0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-a42790d4-d093-487f-bd80-456d18142ac0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:39.107204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:39.108162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:39.109068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 249/489] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 10:11:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:39.109618 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fb48b-8cdc-4640-b5f5-830cd8a5a946 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.109830 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fb48b-8cdc-4640-b5f5-830cd8a5a946 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.110142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fb48b-8cdc-4640-b5f5-830cd8a5a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.125792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affa4a6-9de7-4204-9d93-d2cd1a661591 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.126998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-e19fb48b-8cdc-4640-b5f5-830cd8a5a946 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:39.128222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e19fb48b-8cdc-4640-b5f5-830cd8a5a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:39.161463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.162272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.162555 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.162834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.173159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.174607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:39.193081 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:39.193974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:39.194819 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:39.194819 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:39.194819 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:39.194819 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:39.194819 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 241/490] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:39.195366 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.197908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 250/491] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:39.197908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fb48b-8cdc-4640-b5f5-830cd8a5a946 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.274428 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.300837 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18106fff-9ea3-4c61-b4be-5ce332b5df34 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.308010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fb48b-8cdc-4640-b5f5-830cd8a5a946 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.326361 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.334090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.334899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.335186 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.335499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.345340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.345944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:39.346049 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.346309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.346575 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.347450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:39.347759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.349247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:39.353637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:39.354516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:39.355449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 242/492] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:39.356246 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.391500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 251/493] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:39.392364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.457467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533744cf-7cad-4c00-ae18-6e6852e16403 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.490868 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.491551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.491838 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.492111 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.492830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:39.493121 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.493218 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1947c9-5877-4159-be43-cd9a149f9abd None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.494534 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.496086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.506793 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 243/494] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:39.507638 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.527211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.528119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.528396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.528673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.538673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:39.546658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:39.547752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 252/495] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:39.553817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.583856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.615621 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeab38-65fd-4440-877d-e0de3c76df88 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.649164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631553-726c-4620-a937-055372b0aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.649839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631553-726c-4620-a937-055372b0aa4a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.650121 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631553-726c-4620-a937-055372b0aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.650393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73631553-726c-4620-a937-055372b0aa4a None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.650509 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5e352-d902-4eff-868c-c7d25a54b743 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.651139 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73631553-726c-4620-a937-055372b0aa4a None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:39.651474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73631553-726c-4620-a937-055372b0aa4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.652923 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73631553-726c-4620-a937-055372b0aa4a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.661024 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 244/496] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:39.661625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631553-726c-4620-a937-055372b0aa4a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.685446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.686106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.686390 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.686668 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.715779 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.755414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.756897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.759300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73631553-726c-4620-a937-055372b0aa4a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.788858 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.794035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.794832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.795114 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.795492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.803255 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.804860 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:39.821051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:39.821979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:39.822856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 245/497] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:39.823886 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.867706 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 253/498] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:39.868553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:39.925177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba7128-a481-402b-9b90-f31343739fd5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.941991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:39.960616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:39.961299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:39.961585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:39.961867 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:39.962626 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:39.962939 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:39.964429 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:39.969228 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cec8c-7bd7-46aa-9bdd-14267af87803 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:39.973912 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 246/499] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:39.974751 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.004467 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.005275 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.005549 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.005819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.007786 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.016447 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.017911 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:40.035330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:40.036173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:40.036997 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:40.036997 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:40.036997 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:40.036997 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:40.036997 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 254/500] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:40.037342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.084264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3810-e2dc-45b6-990b-1204a21b006b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.118151 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.118828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.119107 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.119414 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.120263 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:40.120569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.122502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.148398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44be640-64d1-42e5-a7e7-76e718858c6f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.158286 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 247/501] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 10:11:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:40.159095 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.189290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.190188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.190547 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.190895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.201581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.201845 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.203180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:40.221195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:40.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:40.223229 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:40.223229 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:40.223229 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:40.223229 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:40.223229 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 255/502] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:40.223727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.265969 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.269849 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead29748-c3cd-4944-9c0b-f76b0a0c1c69 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.304581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.305406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.305682 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.305950 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.316801 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.318265 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.326245 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf930a08-daa7-441a-9732-5490b2e50b3c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:40.342525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:40.343669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:40.349314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:40.349314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:40.349314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:40.349314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:40.349314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 248/503] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:40.349314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.361309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.361990 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.362276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.362552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.363307 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:40.363618 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.365009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.376936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 256/504] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:40.380224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.431536 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.444461 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee3a6c-f229-4085-ad88-7523e7ca0535 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.475707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.478159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.478813 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.479095 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.479402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.479586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e4555-a842-421c-bead-0f6ddb851422 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.513715 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.514468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.514748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.515020 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.515781 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:40.516090 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.517526 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.528735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 257/505] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:40.529632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.556968 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.558461 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.632070 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87782cf3-d72e-4603-bd0a-ce36fb3148b6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.647245 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.661101 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 249/506] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:40.661934 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.668672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.669430 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.669785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.670136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.670867 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:40.671179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.672633 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.684770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 258/507] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:40.685555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.704018 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.764355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3c487-7078-4480-bc31-4a42eee862d8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.784310 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd45a-29d2-432b-91e7-9ff3870a7928 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.798332 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.799150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.799470 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.799752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.807004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.808666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.822527 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.823380 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.823669 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.824078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:40.824219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:40.831586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 250/508] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:40.832674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.838274 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.839955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:40.854828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:40.856368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 259/509] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:40.857297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:40.879877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.931897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfeec7-c03a-4202-9479-b3ee604467e1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.940975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:40.963038 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736536-cf31-465a-8713-6873d8a40b55 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:40.966376 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:40.967212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:40.967523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:40.967800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:40.977960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:40.979464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:40.998162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:40.999178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:41.000117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:41.000117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:41.000117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:41.000117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:41.000117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 251/510] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:41.000384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.000473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.000540 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.000605 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.000896 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.009423 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.010954 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:41.024998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:41.026052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:41.027188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 260/511] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:41.028463 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.134208 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb78fab-a6ac-4fdb-a346-8c17456946d6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.174473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.175153 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.175455 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.175721 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.176504 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:41.176842 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.178326 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.196615 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.205714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 261/512] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:41.206535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.234101 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.237150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca7b2e-da0f-41bd-811b-b439a2ae5193 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.272350 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.273035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.273324 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.273596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.274451 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:41.274863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.276413 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.294229 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 252/513] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 10:11:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:41.295060 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.318491 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819b87f-9367-40f3-802f-2ae10a23b77c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.353725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.354626 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.355070 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.355552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.356256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:41.356559 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.357963 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.368834 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 262/514] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:41.369809 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.397074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030813-7dbd-4812-9d7e-9ecd3863422e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.429869 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.430469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.430585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.430804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.431078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.431937 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:41.432249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.433764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.453582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 253/515] 10.222.0.67 () {56 vars in 1139 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:41.454373 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.471843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.477909 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa3d49-c07b-4106-8e68-719239f987f6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.510963 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.511820 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.512506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.512788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.513632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=245c6d51f8224624be6289a20874b5b1) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:41.513932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.515405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.520814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 263/516] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/role_assignments?user.id=245c6d51f8224624be6289a20874b5b1&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:41.521581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.564716 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ba84-547c-4359-a950-238c2048fbee None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.603230 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.603929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.604226 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.604503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.640265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbd8e0-cf98-4a60-a190-168463a554b4 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.665620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.679654 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.680778 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.680898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.681308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.681742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.682291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.690821 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.692751 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.705187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:41.708968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:41.709996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 264/517] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:41.711040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.810055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 254/518] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:41.810055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:41.833231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e95ef-d18f-459d-96b0-455560cfa673 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.868837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.869485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.869768 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.870051 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.916344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f698b6-1870-4ee2-9b84-ffb0029886f7 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:41.923558 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.937107 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:41.943477 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.944956 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.957384 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:41.958438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:41.958891 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:41.959455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:41.960417 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:41.960896 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:41.962899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:41.982540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 255/519] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:41.983418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.059804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 265/520] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:42.061387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.094565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ec1e9-929e-4350-85f3-ded8f42c1de4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.130260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.131375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.131834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.132280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.143124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.144886 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.147632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:42.165572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:42.166617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:42.167666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:42.167666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:42.167666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:42.167666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:42.167947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee490fe-bdd8-4a85-ae16-a9161d4b90b3 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.169512 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 256/521] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:42.170431 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.199473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:42.212283 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.212961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.213247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.213524 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.214858 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=edb9cb2a1c8047a8b6b08d3a9df09a36) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:42.215180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.217075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.224369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 266/522] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/role_assignments?user.id=edb9cb2a1c8047a8b6b08d3a9df09a36&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:42.232523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.292091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce5564-e72c-44d7-b7c4-b039e35b2eeb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.333592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.334769 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.335142 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.335548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.350889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.352553 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:42.372390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:42.373527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:42.374577 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:42.374577 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:42.374577 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:42.374577 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:42.375655 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203eeb-e313-4d2f-ae62-48147101fff1 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.381145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 257/523] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:42.382069 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.425138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.425826 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.426113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.426391 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.427127 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:42.427537 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.429125 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.448831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 267/524] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:42.450166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.459424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:42.481802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:42.506795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe55cd4-a782-453f-907f-b1d48aaa47d9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.551297 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.552286 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.552582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.552868 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.553673 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:42.553989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.556030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.568625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c41d48-c922-4186-9452-5cbaa658185d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.572795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 258/525] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:42.581276 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.613541 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.614598 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.614886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.615360 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.623757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.626078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:42.643595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:42.644485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:42.645318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:42.645968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 268/526] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:42.652401 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.700754 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b89cae-91b0-446d-87b9-433e4f394c5a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.725085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:42.741413 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.742618 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.743143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.743617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.751816 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.753656 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.756701 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:42.762171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f16ea-bc2a-44bf-aa80-b5a0884c5a9b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:42.771425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:42.772304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:42.773134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:42.777372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 259/527] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:42.778807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.813874 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.814802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.815096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.815405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.816631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:42.816951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.818680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.837875 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 269/528] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:42.844686 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.900482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01ded-c013-4004-b9ef-c26ba662077e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:42.938776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:42.939905 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:42.940395 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:42.940918 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:42.941918 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:42.942473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:42.951011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:42.965535 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 260/529] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:42.972399 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:42.977872 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e0740-a4a5-45a3-a0fa-30df7b854942 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:43.011762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:43.023075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ebc79-7a4c-4768-b9f4-bf99a644a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:43.023776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ebc79-7a4c-4768-b9f4-bf99a644a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:43.024065 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ebc79-7a4c-4768-b9f4-bf99a644a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:43.024362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ebc79-7a4c-4768-b9f4-bf99a644a2d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:43.025201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ebc79-7a4c-4768-b9f4-bf99a644a2d6 None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=ccd4c1e5951840048c6e647a88787ff5) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:43.025773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ebc79-7a4c-4768-b9f4-bf99a644a2d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:43.028219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ebc79-7a4c-4768-b9f4-bf99a644a2d6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:43.041942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 270/530] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/role_assignments?user.id=ccd4c1e5951840048c6e647a88787ff5&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:43.052086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:43.097350 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea46a2e-1750-44f0-847d-c80288cbfe90 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:43.135999 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c40a7a-1636-45e2-986a-1c8e3e513b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:43.137099 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40a7a-1636-45e2-986a-1c8e3e513b16 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:43.137589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40a7a-1636-45e2-986a-1c8e3e513b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:43.138070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40a7a-1636-45e2-986a-1c8e3e513b16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:43.139250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c40a7a-1636-45e2-986a-1c8e3e513b16 None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=fa4af93cd76845db97b72cfb27664bd7) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:43.139831 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c40a7a-1636-45e2-986a-1c8e3e513b16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:43.141624 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c40a7a-1636-45e2-986a-1c8e3e513b16 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:43.148825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 261/531] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:42 2022] GET /identity/v3/role_assignments?user.id=fa4af93cd76845db97b72cfb27664bd7&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:43.880365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0bb3f-9474-4266-a8f3-a63c21c94d06 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:43.880915 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0bb3f-9474-4266-a8f3-a63c21c94d06 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:43.880915 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0bb3f-9474-4266-a8f3-a63c21c94d06 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:43.882536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 271/532] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:43.889124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7968a9-1676-4b93-875e-0eb37c1f8305 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:43.889584 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7968a9-1676-4b93-875e-0eb37c1f8305 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:43.889682 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7968a9-1676-4b93-875e-0eb37c1f8305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:43.908809 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3a7968a9-1676-4b93-875e-0eb37c1f8305 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:43.910006 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3a7968a9-1676-4b93-875e-0eb37c1f8305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:43.983456 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 262/533] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:44.006731 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0bb3f-9474-4266-a8f3-a63c21c94d06 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.112320 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0bb3f-9474-4266-a8f3-a63c21c94d06 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:44.146255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:44.147071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.147401 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.147685 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.158421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:44.166186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:44.167059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:44.168034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 272/534] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:44.174035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7968a9-1676-4b93-875e-0eb37c1f8305 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.246369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:44.293971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7968a9-1676-4b93-875e-0eb37c1f8305 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:44.329279 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:44.329959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.330242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.330517 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.331284 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:44.331605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:44.332978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:44.342564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 263/535] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:44.349303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.415801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:44.471436 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a130f9-c2fa-4b73-91f7-d7954b01fbf6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:44.506907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9240583-5a67-48dd-b2e2-0b843b662bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:44.507754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240583-5a67-48dd-b2e2-0b843b662bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.508037 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240583-5a67-48dd-b2e2-0b843b662bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.508313 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240583-5a67-48dd-b2e2-0b843b662bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.520008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9240583-5a67-48dd-b2e2-0b843b662bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:44.521476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9240583-5a67-48dd-b2e2-0b843b662bd5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-b9240583-5a67-48dd-b2e2-0b843b662bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:44.539506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:44.540369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:44.541190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:44.541190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:44.541190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:44.541190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:44.541190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 273/536] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:44.547189 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.622038 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf1a4-6099-48ba-8e87-22c2f108bb40 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.622353 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf1a4-6099-48ba-8e87-22c2f108bb40 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.622606 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cf1a4-6099-48ba-8e87-22c2f108bb40 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.624261 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 274/537] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:44.632177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cbd91-325b-470c-9959-cd455ecde604 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.632590 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cbd91-325b-470c-9959-cd455ecde604 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.633310 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cbd91-325b-470c-9959-cd455ecde604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.655923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-511cbd91-325b-470c-9959-cd455ecde604 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:44.657257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-511cbd91-325b-470c-9959-cd455ecde604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:44.657693 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6f32d-9568-443f-aa8f-cf5307e58716 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:44.676948 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:44.697956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:44.698976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.699492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.699931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.700871 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:44.701329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:44.702950 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:44.716260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 264/538] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:44.722260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.751496 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 275/539] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:44.768663 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cbd91-325b-470c-9959-cd455ecde604 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.843672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:44.843947 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb119b4-a5f9-42fb-aaaa-5a1378da109f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:44.884655 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cbd91-325b-470c-9959-cd455ecde604 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:44.892538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:44.893484 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.893866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.894240 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.904986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:44.907064 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:44.924630 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:44.925706 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:44.926308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:44.926556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:44.927670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:44.928720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:44.930215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:44.931342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 265/540] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:44.934348 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.946355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:44.955067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:44.956015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:44.956799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:44.961340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 276/541] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:44.962702 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:44.982260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.061367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29039cc-e41b-4bdc-ad46-e09c725f65bb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.096883 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace5ef4-ca38-4dc6-87b7-67f5c1ae4309 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.098990 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.099572 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.100537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.101039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.101549 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.102607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:45.103147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.104929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.125272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 266/542] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:45.131077 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.143423 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.144112 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.144403 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.144676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.145435 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:45.145743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.147308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.163125 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 277/543] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:45.164521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.254035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.265294 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f72d8-658a-4a2b-ab89-708a7642860e None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.289923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7586d-acae-4a9b-badd-06d79deb35f3 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.318735 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.319989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.320279 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.320565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.333054 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.335121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.335738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.336223 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.336332 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.337819 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.348762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.350591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:45.359629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:45.360496 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:45.361338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:45.361338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:45.361338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:45.361338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:45.363358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 267/544] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:45.367665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:45.376611 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:45.377473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:45.378293 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:45.378293 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:45.378293 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:45.378293 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:45.380564 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 278/545] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:45.386935 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.398212 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.482300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826c55b-b481-4eeb-91a2-97fc07035512 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.516569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37eec52-fc9e-4b05-a790-551118f01c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.516842 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1f454-324f-43ce-a950-12fa49cfd5cc None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.517161 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eec52-fc9e-4b05-a790-551118f01c40 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.517442 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eec52-fc9e-4b05-a790-551118f01c40 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.517715 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37eec52-fc9e-4b05-a790-551118f01c40 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.518470 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eec52-fc9e-4b05-a790-551118f01c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:45.518777 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eec52-fc9e-4b05-a790-551118f01c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.520197 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37eec52-fc9e-4b05-a790-551118f01c40 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.532353 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 268/546] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:45.533575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a09a-155d-4e02-8129-d5ab8ac0c6f3 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.533860 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a09a-155d-4e02-8129-d5ab8ac0c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.534136 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a09a-155d-4e02-8129-d5ab8ac0c6f3 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.535521 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 269/547] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:45.536436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b8298-f986-47bb-9b48-ede05df2c959 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.536945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b8298-f986-47bb-9b48-ede05df2c959 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.537054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b8298-f986-47bb-9b48-ede05df2c959 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.538161 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 270/548] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:45.538849 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b8298-f986-47bb-9b48-ede05df2c959 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.551150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.558076 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aff31-bfca-43a9-a7de-dedb31c5a172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.558943 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aff31-bfca-43a9-a7de-dedb31c5a172 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.559239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aff31-bfca-43a9-a7de-dedb31c5a172 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.559562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aff31-bfca-43a9-a7de-dedb31c5a172 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.560292 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aff31-bfca-43a9-a7de-dedb31c5a172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:45.560605 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aff31-bfca-43a9-a7de-dedb31c5a172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.562019 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aff31-bfca-43a9-a7de-dedb31c5a172 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.574959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 279/549] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:45.576189 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdc4e-0e94-468f-8e8c-8250981d8723 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.576476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdc4e-0e94-468f-8e8c-8250981d8723 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.576753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afdc4e-0e94-468f-8e8c-8250981d8723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.593793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-68afdc4e-0e94-468f-8e8c-8250981d8723 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:45.594989 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-68afdc4e-0e94-468f-8e8c-8250981d8723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:45.648880 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b8298-f986-47bb-9b48-ede05df2c959 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.655889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.663891 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 280/550] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:45.665211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74378-56a2-4c61-a354-7d7ee84ecbd4 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.665497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74378-56a2-4c61-a354-7d7ee84ecbd4 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.665773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d74378-56a2-4c61-a354-7d7ee84ecbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.681451 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-05d74378-56a2-4c61-a354-7d7ee84ecbd4 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:45.682635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-05d74378-56a2-4c61-a354-7d7ee84ecbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:45.697113 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.697923 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.698207 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.698479 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.705759 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.707230 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:45.721002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:45.721959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:45.722789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 271/551] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:45.723793 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.752051 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 281/552] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:45.753163 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74378-56a2-4c61-a354-7d7ee84ecbd4 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.790281 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.825530 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c24fd3-7a0d-4f6d-a554-a18e922601ab None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.860063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d74378-56a2-4c61-a354-7d7ee84ecbd4 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:45.860412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.861223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.861506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.861781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.869943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:45.873130 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:45.885672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:45.889345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:45.890516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:45.891514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 272/553] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:45.892100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.897887 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:45.898695 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:45.898973 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:45.899237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:45.910044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:45.917738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:45.918877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:45.919773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 282/554] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:45.920831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:45.998621 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80a3c6-fad4-4fcf-8e11-39c37d0c4f17 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.019103 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3bd8d-ccea-4080-9197-e2effd6be1eb None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.023371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.032307 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.032983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.033272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.033560 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.034371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:46.034690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.036182 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.048905 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 273/555] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:46.049689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.060716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.061521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.061799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.062074 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.072478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:46.080104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:46.081022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:46.081844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 283/556] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:46.082762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.127964 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.154639 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee79d98-25e1-4b98-a351-3a68ff795696 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.182181 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170869e4-a583-437b-b442-4c918418ee18 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.190706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.191640 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.192091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.192538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.193551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:46.193865 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.195388 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.212721 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 274/557] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:46.213508 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.221351 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.222031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.222311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.222581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.223360 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] RBAC: Adding query filter params (name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:46.223664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.225040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.233622 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 284/558] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:46.234426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.263078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.317731 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06f319-1af5-4253-87e4-d6f26bc8c596 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.337565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa89e2-bf40-4f54-b057-811b3da17018 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.346899 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.351451 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.352420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.352711 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.353206 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] PATH_INFO: `/v3/projects/061cceafef044884ad92a96749c79856/users/245c6d51f8224624be6289a20874b5b1/roles/830cfcbd6b7e49b7859e504127139f9f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.368958 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] RBAC: Authorizing `identity:create_grant(project_id=061cceafef044884ad92a96749c79856, user_id=245c6d51f8224624be6289a20874b5b1, role_id=830cfcbd6b7e49b7859e504127139f9f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.371757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.372571 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.373247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.373532 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.373810 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.374559 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:46.374873 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.376379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.384747 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 285/559] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:46.385559 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.387993 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 275/560] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:46 2022] PUT /identity/v3/projects/061cceafef044884ad92a96749c79856/users/245c6d51f8224624be6289a20874b5b1/roles/830cfcbd6b7e49b7859e504127139f9f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:46.388806 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.499432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.506337 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a789fa9-b253-45ea-9870-978558c8ba20 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.509999 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa055a-6a1d-4e85-a623-656f85e181d1 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.545383 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.546162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.546422 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.546707 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.546981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.547077 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.547321 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.547604 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.558917 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.560362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.560597 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.561846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:46.581634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:46.582569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:46.583932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:46.583932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:46.583932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:46.583932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:46.584278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:46.585327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:46.586427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:46.586427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:46.586427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:46.586427 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:46.586692 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 286/561] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:46.586782 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 276/562] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:46.588236 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.590849 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.617190 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.696086 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c6e69-a9b3-4473-a8f8-663a23a586fc None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.696293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c3f60-d5b1-4a0e-94a2-ef0c89641e78 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.732935 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.733592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.734043 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.734264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.734361 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.734614 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.734805 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.734883 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.735584 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:46.735898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.737289 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.745972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.747480 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.750025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 277/563] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:46.751029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.761309 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:46.769819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:46.770934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:46.776636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:46.776636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:46.776636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:46.776636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:46.776636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 287/564] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:46.776636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.857363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:46.874635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304e1a5-a407-4aef-8e87-82bb5fb13d73 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.884682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb05fa-92a6-4147-960d-8bd746aad152 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:46.910096 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.910777 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.911063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.911380 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.912102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:46.912415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.914604 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.924039 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:46.924859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:46.925148 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:46.925427 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:46.927672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 278/565] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:46.928674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:46.937908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:46.939835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:46.954595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:46.955619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:46.956553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 288/566] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:46.957170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.009775 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.046945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0710c-c447-4419-bb25-c44c77a33599 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.065333 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bab0b-04fe-4faa-8fe6-7aad046cf91f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.086720 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.087421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.087867 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.088149 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.089480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:47.089816 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.091401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.099145 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.100569 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.100856 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.101134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.103516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.104766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 279/567] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:47.109898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.110021 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.111523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:47.127852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:47.128759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:47.129632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 289/568] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:47.130666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.222475 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa977-1ae8-4c7b-953c-aadbef06fd5f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.237590 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f132f-034d-40e1-be5a-2a78b1823c6c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.250882 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.260311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.261004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.261351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.261643 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.262498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:47.262840 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.264293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.275362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.276182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.276466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.276741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.282381 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 280/569] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:47.284537 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.286008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.287487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:47.301297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:47.302273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 10:11:47.303239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:47.306966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 290/570] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:47.307934 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.366086 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.398679 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226b62-73a9-4ed0-9cbc-451a685484bd None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.412369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51142836-f482-4f43-95dd-d131021e7220 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.434659 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.435361 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.435662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.435945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.436710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:47.437025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.438832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.448349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.449193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.449483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.449853 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.456122 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 281/571] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:47.456122 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.466113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.467718 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:47.486472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:47.487437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:47.488312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:47.488312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:47.488312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:47.488312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:47.488312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 291/572] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:47.488595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.508467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.567939 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b675c-ee80-4b62-be99-68c329835481 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.601808 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a5487-507d-45d8-8ff7-9f8913a745a3 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.603313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.604007 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.604370 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.604660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.605851 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:47.605851 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.607341 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.610312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.625622 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 282/573] 10.222.0.67 () {56 vars in 1139 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:47.626193 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.645649 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.646560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.646833 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.647106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] PATH_INFO: `/v3/projects/061cceafef044884ad92a96749c79856/users/edb9cb2a1c8047a8b6b08d3a9df09a36/roles/830cfcbd6b7e49b7859e504127139f9f` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.664021 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] RBAC: Authorizing `identity:create_grant(project_id=061cceafef044884ad92a96749c79856, user_id=edb9cb2a1c8047a8b6b08d3a9df09a36, role_id=830cfcbd6b7e49b7859e504127139f9f)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.665538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.691311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 292/574] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:47 2022] PUT /identity/v3/projects/061cceafef044884ad92a96749c79856/users/edb9cb2a1c8047a8b6b08d3a9df09a36/roles/830cfcbd6b7e49b7859e504127139f9f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:47.691311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.751526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd78524-c154-4b10-8245-a81934a2cd35 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.754325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.793695 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.794559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.794946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.795373 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.796233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:47.796650 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.798168 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.811614 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 283/575] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:47.814620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfb69-5be7-4c0e-ba61-36de3278a998 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:47.825275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.854303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:47.855406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:47.856236 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:47.857050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:47.871840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:47.873384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:47.899109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:47.900075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:47.901971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:47.901971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:47.901971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:47.901971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:47.901971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 293/576] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:47.906368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:47.920722 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:47.967701 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838ad6e-73bb-474a-8f0d-8fe9a756f08f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:48.011124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:48.012041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.012327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.012648 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.022655 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:48.024448 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:48.038806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a0660-cdaf-468d-b4e0-f720a4a5c16f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:48.039765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:48.040607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:48.041908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 284/577] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:48.047801 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:48.074210 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:48.085874 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:48.087391 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.087680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.087959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.088694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:48.089002 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:48.090465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:48.105852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 294/578] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:48.111336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:48.164874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1dae2-3f19-4725-89ef-f71e1cb2cedc None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:48.197739 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:48.202382 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:48.203744 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.204696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.204696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.205520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:48.205844 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:48.207350 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:48.226830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 285/579] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:48.228850 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:48.246607 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958383d-25df-4fce-8c15-58184b69cd6e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:48.284656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:48.285468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.285745 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.286015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.293532 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:48.295054 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:48.310040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:48.310986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:48.311968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:48.316302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 295/580] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:48.317603 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:48.359344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:48.388149 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc666a-e5d2-4d0c-897c-72662af95f27 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:48.423179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:48.424029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.424312 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.424587 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] PATH_INFO: `/v3/projects/061cceafef044884ad92a96749c79856/users/ccd4c1e5951840048c6e647a88787ff5/roles/830cfcbd6b7e49b7859e504127139f9f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.441095 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] RBAC: Authorizing `identity:create_grant(project_id=061cceafef044884ad92a96749c79856, user_id=ccd4c1e5951840048c6e647a88787ff5, role_id=830cfcbd6b7e49b7859e504127139f9f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:48.442561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:48.443003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5a01f-f489-4f5a-ab60-d69061eea83b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:48.463307 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 286/581] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:48 2022] PUT /identity/v3/projects/061cceafef044884ad92a96749c79856/users/ccd4c1e5951840048c6e647a88787ff5/roles/830cfcbd6b7e49b7859e504127139f9f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:48.487991 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:48.498708 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf46b1-cd2e-4355-b109-784806ca51c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:48.499838 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf46b1-cd2e-4355-b109-784806ca51c9 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.500562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf46b1-cd2e-4355-b109-784806ca51c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.501259 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf46b1-cd2e-4355-b109-784806ca51c9 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.502395 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf46b1-cd2e-4355-b109-784806ca51c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:48.502859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf46b1-cd2e-4355-b109-784806ca51c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:48.504724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf46b1-cd2e-4355-b109-784806ca51c9 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:48.523388 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 296/582] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:48.525701 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:48.641945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd87e82-26e6-4943-912f-3a81583c3361 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:48.674380 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:48.679371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bf6f0-235c-41b9-83c1-af4f7dbe0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:48.680291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf6f0-235c-41b9-83c1-af4f7dbe0b31 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.680598 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf6f0-235c-41b9-83c1-af4f7dbe0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.680848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf6f0-235c-41b9-83c1-af4f7dbe0b31 None admin] PATH_INFO: `/v3/projects/061cceafef044884ad92a96749c79856/users/fa4af93cd76845db97b72cfb27664bd7/roles/830cfcbd6b7e49b7859e504127139f9f` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.697338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bf6f0-235c-41b9-83c1-af4f7dbe0b31 None admin] RBAC: Authorizing `identity:create_grant(project_id=061cceafef044884ad92a96749c79856, user_id=fa4af93cd76845db97b72cfb27664bd7, role_id=830cfcbd6b7e49b7859e504127139f9f)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:48.698908 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bf6f0-235c-41b9-83c1-af4f7dbe0b31 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:48.719382 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 287/583] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:11:48 2022] PUT /identity/v3/projects/061cceafef044884ad92a96749c79856/users/fa4af93cd76845db97b72cfb27664bd7/roles/830cfcbd6b7e49b7859e504127139f9f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:11:48.745113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93731ac-dabc-470a-b047-6f05ef831490 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.745480 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93731ac-dabc-470a-b047-6f05ef831490 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.745716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93731ac-dabc-470a-b047-6f05ef831490 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.747504 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 297/584] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:48.753390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527c09-ed1a-43b9-b0d7-62507f526e9e None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:48.753718 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527c09-ed1a-43b9-b0d7-62507f526e9e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:48.753965 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527c09-ed1a-43b9-b0d7-62507f526e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:48.772764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-66527c09-ed1a-43b9-b0d7-62507f526e9e None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:48.774004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-66527c09-ed1a-43b9-b0d7-62507f526e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:48.858504 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 288/585] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:48.885219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93731ac-dabc-470a-b047-6f05ef831490 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:48.998506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93731ac-dabc-470a-b047-6f05ef831490 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:49.033952 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:49.034779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:49.035065 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:49.035371 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:49.046590 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:49.054577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:49.055528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:49.056342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 298/586] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:49.062282 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527c09-ed1a-43b9-b0d7-62507f526e9e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:49.174114 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527c09-ed1a-43b9-b0d7-62507f526e9e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:49.188928 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:49.212959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:49.213982 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:49.214839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:49.215728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:49.216688 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:49.217199 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:49.218779 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:49.227925 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 289/587] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:49.233394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:49.294171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:49.346629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a3090-6cb1-4e8f-9e41-486f0ae922ee None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:49.380795 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:49.381603 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:49.381884 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:49.382156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:49.393215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:49.394683 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:49.415365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:49.416308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:49.417182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:49.417182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:49.417182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:49.417182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:49.417182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 299/588] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:49.422514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:49.532334 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bdf4-b5bd-4f4d-88cf-87fd55b34da1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:49.567719 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:49.568773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:49.569262 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:49.569752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:49.570705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:49.571216 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:49.572842 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:49.585900 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 290/589] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:49.593048 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:49.694753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:49.697510 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b2dea-99e7-4819-94af-20ab95b9b4e5 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:49.732191 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:49.733014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:49.733302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:49.733575 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:49.742646 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:49.744250 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:49.760576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:49.761637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:49.762552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 300/590] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 10:11:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:49.767691 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:49.810056 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:49.887530 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a581c-a979-4c87-bb55-ce2d53416c95 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:49.924228 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb076de-d10f-4767-83ce-3c99830580b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:49.924917 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb076de-d10f-4767-83ce-3c99830580b3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:49.925199 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb076de-d10f-4767-83ce-3c99830580b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:49.925479 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb076de-d10f-4767-83ce-3c99830580b3 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:49.926332 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb076de-d10f-4767-83ce-3c99830580b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:49.926648 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb076de-d10f-4767-83ce-3c99830580b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:49.928133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb076de-d10f-4767-83ce-3c99830580b3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:49.947534 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 291/591] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 10:11:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:49.953196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.055875 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1952-2eaa-40ce-aece-e7cf5e4ee6c1 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.056206 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1952-2eaa-40ce-aece-e7cf5e4ee6c1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.056434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea1952-2eaa-40ce-aece-e7cf5e4ee6c1 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.058080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 292/592] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:11:50.063387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4394c-4a5b-43aa-9ae0-3f1ad1640367 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.063966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4394c-4a5b-43aa-9ae0-3f1ad1640367 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.063966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4394c-4a5b-43aa-9ae0-3f1ad1640367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.073483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f954325-0c25-4a99-b5d1-4abe9fa5f4c5 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:50.080698 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7dd4394c-4a5b-43aa-9ae0-3f1ad1640367 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:50.081819 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7dd4394c-4a5b-43aa-9ae0-3f1ad1640367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:50.110503 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:50.111167 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.111483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.111800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.142890 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:50.163297 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 293/593] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:50.182325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4394c-4a5b-43aa-9ae0-3f1ad1640367 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.192444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:50.194614 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:50.210234 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:50.309298 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 301/594] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:50.313744 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4394c-4a5b-43aa-9ae0-3f1ad1640367 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:50.314879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.358897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:50.360029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.360523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.360938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.376085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:50.386485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:50.387979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:50.389105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:50.390172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:50.393006 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 294/595] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:50.400257 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.439197 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d69bb-7030-405e-a68f-325bd7b3a356 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:50.476812 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:50.477913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.478345 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.478858 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.485891 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:50.491732 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:50.493441 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:50.505714 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c5240-ee21-4a70-b1d5-a8a3063ad532 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:50.514497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:50.515591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:50.516465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:50.516465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:50.516465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:50.516465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:50.518822 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 302/596] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:50.527327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.541336 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:50.542156 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.542589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.542975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.544023 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:50.544399 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:50.546102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:50.559381 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 295/597] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:50.560542 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.641625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6deed-2ad9-444c-8523-76871c245b91 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:50.656907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:50.672388 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93421127-8f75-4624-9a22-7a83435ff920 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:50.679806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:50.680678 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.680864 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.681142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.681873 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:50.682178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:50.684010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:50.697171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 303/598] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:50.702682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.710669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:50.711525 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.711807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.712082 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.724482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:50.726048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:50.729119 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:50.746411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:50.747578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:50.748684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:50.748684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:50.748684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:50.748684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:50.751308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 296/599] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:50.756282 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.878770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4322-2f0f-4219-a03f-d55ed9b2d6c4 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:50.914272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:50.915315 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:50.915836 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:50.916314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:50.917346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:50.917977 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:50.919616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:50.932742 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 297/600] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:50.940684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:50.966780 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6128a-c05f-44b7-ba1c-f0df7441cc07 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.002002 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a235f2-6834-4c37-b9ff-c2446a860183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.002807 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a235f2-6834-4c37-b9ff-c2446a860183 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.003084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a235f2-6834-4c37-b9ff-c2446a860183 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.003385 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a235f2-6834-4c37-b9ff-c2446a860183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.006418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.010468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a235f2-6834-4c37-b9ff-c2446a860183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:51.012027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a235f2-6834-4c37-b9ff-c2446a860183 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-b1a235f2-6834-4c37-b9ff-c2446a860183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:51.026036 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:51.027066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 304/601] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60300-78f8-48a3-8dd5-e0cd0200f704 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.032971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60300-78f8-48a3-8dd5-e0cd0200f704 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.033591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc60300-78f8-48a3-8dd5-e0cd0200f704 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.033591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 305/602] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:51.033591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc60300-78f8-48a3-8dd5-e0cd0200f704 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.057815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5d602-517c-4b61-9fc2-f611d6e6fdbe None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.069578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.096292 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e0a0-af9f-468c-92ac-abc0b4b4a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.097291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e0a0-af9f-468c-92ac-abc0b4b4a042 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.097689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e0a0-af9f-468c-92ac-abc0b4b4a042 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.098494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e0a0-af9f-468c-92ac-abc0b4b4a042 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.106571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e0a0-af9f-468c-92ac-abc0b4b4a042 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:51.108169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e0a0-af9f-468c-92ac-abc0b4b4a042 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-a562e0a0-af9f-468c-92ac-abc0b4b4a042 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:51.123160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:51.124330 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:51.125425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 298/603] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:51.126178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc092be-1cfe-439c-82d7-c45fa15f2bae None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.126469 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc092be-1cfe-439c-82d7-c45fa15f2bae None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.126750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc092be-1cfe-439c-82d7-c45fa15f2bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.143889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-edc092be-1cfe-439c-82d7-c45fa15f2bae None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:51.145202 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-edc092be-1cfe-439c-82d7-c45fa15f2bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:51.154377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc60300-78f8-48a3-8dd5-e0cd0200f704 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.191761 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.192606 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.192897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.193186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.194062 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:51.194370 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:51.195849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:51.210226 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 306/604] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:51.211143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.225725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 299/605] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:51.227001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc092be-1cfe-439c-82d7-c45fa15f2bae None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.289179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.314508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.324923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a509-908c-47dc-8e7e-2e7dabc35160 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.344320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc092be-1cfe-439c-82d7-c45fa15f2bae None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.357074 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.357751 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.358030 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.358304 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.359137 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:51.359480 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:51.360915 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:51.377595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 307/606] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:51.378379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.384174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366e4e5-34cd-4172-8a2f-9ee7a1d296b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.384852 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e4e5-34cd-4172-8a2f-9ee7a1d296b3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.385137 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e4e5-34cd-4172-8a2f-9ee7a1d296b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.385414 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366e4e5-34cd-4172-8a2f-9ee7a1d296b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.386262 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366e4e5-34cd-4172-8a2f-9ee7a1d296b3 None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=245c6d51f8224624be6289a20874b5b1) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:51.386580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366e4e5-34cd-4172-8a2f-9ee7a1d296b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:51.388097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366e4e5-34cd-4172-8a2f-9ee7a1d296b3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:51.394500 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 300/607] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/role_assignments?user.id=245c6d51f8224624be6289a20874b5b1&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:51.395769 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d8dd-3179-47a6-abd7-64683e54f3cd None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.396063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d8dd-3179-47a6-abd7-64683e54f3cd None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.396342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d8dd-3179-47a6-abd7-64683e54f3cd None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.397558 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 301/608] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:51.398258 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042d8dd-3179-47a6-abd7-64683e54f3cd None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.512211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d071d-c7d6-4811-b2de-559cd598ea0e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.529303 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042d8dd-3179-47a6-abd7-64683e54f3cd None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.544992 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.550025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8923a-fbdc-4dac-8910-ea968670dc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.550797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8923a-fbdc-4dac-8910-ea968670dc46 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.551082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8923a-fbdc-4dac-8910-ea968670dc46 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.551376 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8923a-fbdc-4dac-8910-ea968670dc46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.563766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8923a-fbdc-4dac-8910-ea968670dc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-c2d8923a-fbdc-4dac-8910-ea968670dc46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:51.571585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:51.572729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:51.573720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 308/609] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:51.575405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57616677-5cb6-451a-b863-55135ff92e7a None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.575405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57616677-5cb6-451a-b863-55135ff92e7a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.575405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57616677-5cb6-451a-b863-55135ff92e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.576368 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.577129 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.577419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.577695 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.596753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-57616677-5cb6-451a-b863-55135ff92e7a None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:51.598385 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-57616677-5cb6-451a-b863-55135ff92e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:51.600916 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.661596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:51.663076 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:51.680357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 309/610] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:51.681015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57616677-5cb6-451a-b863-55135ff92e7a None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.790164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 302/611] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:51.790164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.793978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57616677-5cb6-451a-b863-55135ff92e7a None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.807303 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.832405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.833090 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.833366 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.833633 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.834381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] RBAC: Adding query filter params (name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:51.834680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:51.836085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:51.844397 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 310/612] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:51.845287 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.848281 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:51.912305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913c5ff-4e48-4675-83ce-575d808b5783 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.951491 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.951705 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509586-14fd-4aa9-b0ec-278b7985a7bf None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:51.952716 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.953261 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.953830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:51.968425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:51.977052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:51.978005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:51.978841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 303/613] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:51.980212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:51.993398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:51.994221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:51.994497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:51.994911 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.007212 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.008697 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:52.027262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:52.028262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:52.029157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:52.029157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:52.029157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:52.029157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:52.033897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 311/614] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:52.034197 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.058821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.098008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.098216 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1f8c9-6648-4092-bd22-a8a4a92f5567 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.144499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.145313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.145612 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.145956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.148245 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d388dc0-afda-4aac-90f2-86ccf34d439b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.157464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.158957 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:52.176567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:52.177489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:52.179097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:52.179097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:52.179097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:52.179097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:52.179097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 304/615] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:52.179097 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.198913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.199724 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.200024 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.200288 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.201063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:52.201357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.202752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.211341 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 312/616] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:52.212009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.295579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb806104-20c0-4486-a72e-71eb1a1d6a11 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.320663 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.322610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4342c5-bd2f-47b6-89ed-1c75022fcac7 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.335340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.335992 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.336282 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.336565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.337305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:52.337620 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.339013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.340732 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.356989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 305/617] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:52.356989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.366827 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.367628 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.367978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.368340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.369143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:52.369513 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.371544 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.388480 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 313/618] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:52.388480 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.471596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145dfb63-95fa-4526-88e1-4182112155c6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.492903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831f1e6-a78d-48ef-8540-170a586dcc2a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.510884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.512076 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.512368 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.512658 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.523191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.524693 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.531057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.531899 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.532404 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.532525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.539209 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.540748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:52.543580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:52.544440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:52.550672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:52.550672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:52.550672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:52.550672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:52.550672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 306/619] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:52.550672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:52.554505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:52.555601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 314/620] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:52.562523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.591771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.599146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.663228 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf504f-cfe8-479b-b069-cc8a8b14c38f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.666317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf157c-c754-4b79-8e56-ae72d53a2c41 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.699719 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.700099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.700407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.700695 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.700971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.701578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.701690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:52.701990 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.702236 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.702649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.703410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.711677 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.713374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.715159 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 315/621] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:52.716010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:52.733616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:52.734788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:11:52.735964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:52.742872 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 307/622] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:52.743965 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.820319 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.828236 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f97a5-e634-4c2e-afc9-d26579803e53 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.849785 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:52.857466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7f158-bd73-41bd-85cc-98ace35a4e19 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:52.866680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.867387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.867672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.867925 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.868720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:52.869031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.870562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.882412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 316/623] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:52.883203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.900535 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:52.901565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:52.901996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:52.902397 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:52.914331 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:52.915883 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:52.930527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:52.931727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 308/624] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:52.937510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:52.997020 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39576b-ad43-488d-ab72-4742a32fe241 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.034150 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.035077 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.035582 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.036049 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.036544 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506668da-e8f9-4050-a119-3d0731d24891 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.037405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:53.037981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.039538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.058708 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 317/625] 10.222.0.67 () {56 vars in 1137 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:53.059694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:53.076752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.082352 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.083066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.083387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.083696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.084542 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=edb9cb2a1c8047a8b6b08d3a9df09a36) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:53.084854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.086307 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.103391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 309/626] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:52 2022] GET /identity/v3/role_assignments?user.id=edb9cb2a1c8047a8b6b08d3a9df09a36&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:53.103391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:53.123487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.196750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4b4c5-e61b-442e-b9ee-ce0dfb9067f5 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.237410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.238202 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.238551 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.238842 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c641c-5cc0-4d3c-8176-8ae8667aa7c5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.238979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.239976 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:53.240356 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.242129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.264365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 318/627] 10.222.0.67 () {56 vars in 1139 bytes} [Wed May 25 10:11:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:53.269634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:53.287431 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.288250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.288543 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.288922 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.352267 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.383738 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.385259 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.393265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf1be-6411-44c2-9089-81d1e5bf0074 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.408506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.436661 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.437687 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.438570 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.438570 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.505761 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 310/628] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:53.512907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:53.520254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.522068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.607414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.641502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f72f2-fa08-42c9-9019-f93987102b0a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.642653 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 319/629] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 10:11:53.648376 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:53.661091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.681411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.682327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.682526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.682808 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.695116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.696815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:53.717434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:53.718412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:53.719412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:53.719412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:53.719412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:53.719412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:53.723325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 311/630] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:53.724485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:53.760751 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838dc60-3aa1-42eb-9e69-51a2335403ac None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.797499 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2544f-2948-4042-a486-149f6770a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.798719 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2544f-2948-4042-a486-149f6770a81d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.799004 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2544f-2948-4042-a486-149f6770a81d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.799301 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2544f-2948-4042-a486-149f6770a81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.812793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2544f-2948-4042-a486-149f6770a81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.814613 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2544f-2948-4042-a486-149f6770a81d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-a7d2544f-2948-4042-a486-149f6770a81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:53.833085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:53.833971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:53.834843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:53.834843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:53.834843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:53.834843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:53.839357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 320/631] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:53.840806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e760cf3-2b67-4224-9b64-4a22bbc722f0 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.841096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e760cf3-2b67-4224-9b64-4a22bbc722f0 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.841484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e760cf3-2b67-4224-9b64-4a22bbc722f0 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.842511 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f711a4-4b9b-4b6b-a838-fb7c963ee333 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:53.847311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 321/632] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:53.847311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e760cf3-2b67-4224-9b64-4a22bbc722f0 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:53.876846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.888629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f68737-1875-4a1c-a3c4-2cce7b87474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:53.889322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f68737-1875-4a1c-a3c4-2cce7b87474d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.889862 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f68737-1875-4a1c-a3c4-2cce7b87474d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.890144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f68737-1875-4a1c-a3c4-2cce7b87474d None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.891893 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f68737-1875-4a1c-a3c4-2cce7b87474d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:53.892134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f68737-1875-4a1c-a3c4-2cce7b87474d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:53.893632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f68737-1875-4a1c-a3c4-2cce7b87474d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:53.909790 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 312/633] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:53.915948 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f129-2c39-4c90-8a32-73ce68909163 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:53.915948 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f129-2c39-4c90-8a32-73ce68909163 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:53.915948 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f129-2c39-4c90-8a32-73ce68909163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:53.930888 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f3f2f129-2c39-4c90-8a32-73ce68909163 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:53.932124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f3f2f129-2c39-4c90-8a32-73ce68909163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:53.958564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:53.967751 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e760cf3-2b67-4224-9b64-4a22bbc722f0 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.004461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67291-8644-42db-a787-f73d560f654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.005141 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67291-8644-42db-a787-f73d560f654c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.011345 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67291-8644-42db-a787-f73d560f654c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.011671 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 313/634] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:54.012193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c67291-8644-42db-a787-f73d560f654c None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.012193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67291-8644-42db-a787-f73d560f654c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:54.012377 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2f129-2c39-4c90-8a32-73ce68909163 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.012476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67291-8644-42db-a787-f73d560f654c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.012476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c67291-8644-42db-a787-f73d560f654c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.030820 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 322/635] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:54.032468 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67291-8644-42db-a787-f73d560f654c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.118347 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2f129-2c39-4c90-8a32-73ce68909163 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.120762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:54.138540 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c67291-8644-42db-a787-f73d560f654c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.154007 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.154754 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.155040 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.155343 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.162030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.163529 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.174027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.174832 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.175117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.175431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:54.177213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:54.178118 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:54.179000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 314/636] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:54.179549 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.189193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.190671 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:54.207084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:54.208075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:54.208978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 323/637] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:54.209489 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.217849 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:54.302792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0c518-9a6e-4b5e-af5f-658e7d409ca5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.320181 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdfbed-316a-4828-8a8c-d10257b2d12d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.344167 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.344974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.345257 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.345533 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.354796 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.355586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.355875 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.356156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.356966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:54.357280 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.357491 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:54.358775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:54.366702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:54.368372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:54.369588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 315/638] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:54.370331 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.374847 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 324/639] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:54.375971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.381416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:54.464960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:54.490375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2a6c9-0070-4db6-a188-ad819d14a740 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.495547 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49e26a-e59d-4280-94e5-69744136ccc5 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.526833 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.527545 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.527793 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.528061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.528885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:54.529194 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.530624 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.540376 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.541547 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.542016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.543079 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 316/640] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:54.543205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.543837 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.544364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:54.544851 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.546242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.557237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 325/641] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:54.558097 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.632273 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:54.657317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a74c97-c41b-4b6a-a730-7a32ae4d415f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.669249 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028193c6-7b49-497b-b502-2c6e9c58d22d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.692942 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.693764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.694177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.694432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.695263 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=ccd4c1e5951840048c6e647a88787ff5) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:54.695604 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.697379 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.705829 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.706504 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.706791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.707071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.707968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=fa4af93cd76845db97b72cfb27664bd7) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:54.708287 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.709793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.711038 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 317/642] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/role_assignments?user.id=ccd4c1e5951840048c6e647a88787ff5&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:54.719393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:54.727457 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 326/643] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/role_assignments?user.id=fa4af93cd76845db97b72cfb27664bd7&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:54.727939 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:54.852825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ed3f9-b4e4-4459-b946-962cb9cf060d None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:54.892922 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:54.894274 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:54.894831 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:54.895331 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:54.909251 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:54.911103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:54.930920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:54.931938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:54.932804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:54.932804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:54.932804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:54.932804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:54.934953 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 318/644] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:54.941421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:55.074533 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944aaf-355a-4532-a11c-ebeb06b0638a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:55.105097 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:55.112314 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:55.113003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:55.113286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:55.113564 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:55.114298 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:55.114606 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:55.116040 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:55.128785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 327/645] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:55.134251 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:55.201626 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:55.255883 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6be8c-639e-48f8-95e1-819786d0d151 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:55.292527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:55.293467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:55.293759 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:55.294038 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:55.303620 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:55.305127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:11:55.326841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:55.327834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:55.328762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 319/646] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 10:11:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:55.335381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:55.461521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206e5b-c36e-4d1f-be9c-c9984de5a88a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:55.497959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6cf90-5039-43c5-b82e-95102b0110c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:55.498886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6cf90-5039-43c5-b82e-95102b0110c9 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:55.499376 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6cf90-5039-43c5-b82e-95102b0110c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:55.499859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6cf90-5039-43c5-b82e-95102b0110c9 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:55.504931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6cf90-5039-43c5-b82e-95102b0110c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:55.504931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6cf90-5039-43c5-b82e-95102b0110c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:55.504931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6cf90-5039-43c5-b82e-95102b0110c9 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:55.524793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 328/647] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 10:11:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:55.532091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:55.618887 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035e07-75ec-4460-8fb9-ccd46a5706f6 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:55.619067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035e07-75ec-4460-8fb9-ccd46a5706f6 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:55.619465 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035e07-75ec-4460-8fb9-ccd46a5706f6 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:55.621193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 329/648] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:55.626639 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509f92-85ff-4dfa-a72f-cf3dd64543bc None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:55.626932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509f92-85ff-4dfa-a72f-cf3dd64543bc None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:55.627215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509f92-85ff-4dfa-a72f-cf3dd64543bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:55.649978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-10509f92-85ff-4dfa-a72f-cf3dd64543bc None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:55.653164 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-10509f92-85ff-4dfa-a72f-cf3dd64543bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:55.675861 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd2042-bd81-4da3-8b95-310808cc9775 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:55.693424 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:55.709232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:55.712929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:55.713801 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:55.714409 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:55.715021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:55.742620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 330/649] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:11:55.768490 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10509f92-85ff-4dfa-a72f-cf3dd64543bc None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:55.803672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:55.805166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:55.914643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10509f92-85ff-4dfa-a72f-cf3dd64543bc None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:55.940831 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 320/650] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 10:11:55.948549 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:55.969641 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:55.971541 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:55.972062 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:55.972538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] PATH_INFO: `/v3/services/image` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:55.973141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:55.974367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:55.976336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:55.999110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:56.000194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:11:56.001008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:56.009185 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 331/651] 10.222.0.67 () {56 vars in 1105 bytes} [Wed May 25 10:11:55 2022] GET /identity/v3/services/image => generated 86 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:56.013448 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:56.087566 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:56.097625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da8dca-f9be-4073-b2e2-093a98bdda88 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:56.137483 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:56.138562 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:56.138685 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:56.138965 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:56.150711 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:56.152421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:56.166988 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b8aa3-9a25-49e6-99a6-655ba1b3af1a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:11:56.172466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:56.173627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:56.174519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:11:56.174519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:11:56.174519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:11:56.174519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:56.174519 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 321/652] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:56.180856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:56.207079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:56.208008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:56.208389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:56.208725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:56.209487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:56.209852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:56.213742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:56.221964 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 332/653] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:56.223408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:56.269783 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:56.317582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f73e6-cc25-4808-b701-afd31fd26448 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:56.342690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0faca8-674f-49ad-ab48-7c3e8d5b20b2 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:56.350841 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:56.356945 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:56.357924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:56.358424 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:56.359020 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:56.360091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:56.360606 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:56.362224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:56.380342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 322/654] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:56.381689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:56.383151 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:56.384013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:56.384355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:56.384716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:56.385639 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] RBAC: Adding query filter params (type=image) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:56.386129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:56.387859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:56.399782 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 333/655] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:56.508696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a52a03-c38d-4b13-9165-ace632737534 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:56.539822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:56.550445 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:56.551295 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:56.551592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:56.551870 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:56.559966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:56.561526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:11:56.577085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:56.578153 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:56.579032 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 323/656] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:56.588526 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:56.708636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966e803-aadd-43db-92c9-c4f76137ae68 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:56.744261 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f57d0a-86ea-4ccd-a24e-b13f89e10c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:56.745347 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57d0a-86ea-4ccd-a24e-b13f89e10c27 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:56.746055 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57d0a-86ea-4ccd-a24e-b13f89e10c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:56.746601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f57d0a-86ea-4ccd-a24e-b13f89e10c27 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:56.747694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57d0a-86ea-4ccd-a24e-b13f89e10c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:56.748208 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57d0a-86ea-4ccd-a24e-b13f89e10c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:56.749870 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f57d0a-86ea-4ccd-a24e-b13f89e10c27 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:56.763266 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 334/657] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:56.769531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:56.878116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d7bf-08a1-425b-ab9f-ff97544ffdc5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:56.916472 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5f296-8f4c-483e-a000-d1a5995e391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:56.917139 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5f296-8f4c-483e-a000-d1a5995e391c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:56.917537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5f296-8f4c-483e-a000-d1a5995e391c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:56.917842 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5f296-8f4c-483e-a000-d1a5995e391c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:56.918722 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5f296-8f4c-483e-a000-d1a5995e391c None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=061cceafef044884ad92a96749c79856, user.id=245c6d51f8224624be6289a20874b5b1) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:56.919035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5f296-8f4c-483e-a000-d1a5995e391c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:56.920528 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5f296-8f4c-483e-a000-d1a5995e391c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:56.926913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 324/658] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:11:56 2022] GET /identity/v3/role_assignments?user.id=245c6d51f8224624be6289a20874b5b1&scope.project.id=061cceafef044884ad92a96749c79856&role.id=079434fe84194c03ae64e10d61e222e6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:57.283420 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb470f5f-ab1e-4e40-a851-8be0389a20b9 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.284159 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb470f5f-ab1e-4e40-a851-8be0389a20b9 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.284643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb470f5f-ab1e-4e40-a851-8be0389a20b9 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.286478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 335/659] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:57.291926 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145150-fe64-494e-80a1-27a93a6bbf6f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.292623 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145150-fe64-494e-80a1-27a93a6bbf6f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.292623 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145150-fe64-494e-80a1-27a93a6bbf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.310062 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-81145150-fe64-494e-80a1-27a93a6bbf6f None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:57.311285 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-81145150-fe64-494e-80a1-27a93a6bbf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:57.341316 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d8c10-1ecb-4f6b-a880-44f96c0f18a1 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.341657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d8c10-1ecb-4f6b-a880-44f96c0f18a1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.341862 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d8c10-1ecb-4f6b-a880-44f96c0f18a1 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.343470 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 336/660] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:57.348472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e1e79-5bdf-4319-b021-b72d192a4e02 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.348753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e1e79-5bdf-4319-b021-b72d192a4e02 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.349030 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e1e79-5bdf-4319-b021-b72d192a4e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.362492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:57.366939 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-d27e1e79-5bdf-4319-b021-b72d192a4e02 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:57.368151 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-d27e1e79-5bdf-4319-b021-b72d192a4e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:57.391863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 325/661] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:57.392913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:57.416077 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81145150-fe64-494e-80a1-27a93a6bbf6f None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:57.446293 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 337/662] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:57.469052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e1e79-5bdf-4319-b021-b72d192a4e02 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:57.520284 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81145150-fe64-494e-80a1-27a93a6bbf6f None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:57.555711 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:57.556468 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.556755 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.557035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.557695 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:57.559227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:57.575567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:57.576559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:11:57.577415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:11:57.583057 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 326/663] 10.222.0.67 () {56 vars in 1129 bytes} [Wed May 25 10:11:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:57.584363 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:57.599260 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e1e79-5bdf-4319-b021-b72d192a4e02 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:57.642134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:57.651976 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:57.653386 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.654112 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.654566 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] PATH_INFO: `/v3/services/network` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.656095 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:57.658340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:57.674205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:57.675237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:11:57.676106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:57.683155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 338/664] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:11:57 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:11:57.684581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:57.714105 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed761f-f985-44d5-9999-553588dc4e3c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:57.715993 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:57.759416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:57.760216 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.760534 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.760950 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.761962 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:57.762337 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:57.763854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:57.769087 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 327/665] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 10:11:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:57.774382 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:57.814556 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bf7e3-6420-47ca-9f4b-2e17423abd0c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:57.856960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:57.857808 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.858086 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.858433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.859256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] RBAC: Adding query filter params (name=network) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:57.859676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:57.861188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:57.866181 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 339/666] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:11:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:57.871923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:57.911594 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da3c5-a7b1-44cf-87ae-a344559e13a2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:57.922636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:57.949469 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5826c95-f6c2-4139-9396-fc569605d2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:57.950284 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5826c95-f6c2-4139-9396-fc569605d2cf None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:57.950670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5826c95-f6c2-4139-9396-fc569605d2cf None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:57.951050 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5826c95-f6c2-4139-9396-fc569605d2cf None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:57.951916 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5826c95-f6c2-4139-9396-fc569605d2cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:57.952326 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5826c95-f6c2-4139-9396-fc569605d2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:57.953818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5826c95-f6c2-4139-9396-fc569605d2cf None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:57.967401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 328/667] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 10:11:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:11:57.987693 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:58.002542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf67e1-1b67-4ffd-8fcf-222efc172576 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:58.041299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ed94-49fc-4c19-a8ad-238b401b1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:58.042358 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ed94-49fc-4c19-a8ad-238b401b1909 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:58.042994 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ed94-49fc-4c19-a8ad-238b401b1909 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:58.043581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ed94-49fc-4c19-a8ad-238b401b1909 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:58.044487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ed94-49fc-4c19-a8ad-238b401b1909 None admin] RBAC: Adding query filter params (type=network) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:58.044943 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ed94-49fc-4c19-a8ad-238b401b1909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:58.046527 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ed94-49fc-4c19-a8ad-238b401b1909 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:58.052660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 340/668] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:11:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:58.839749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4709b-efb5-4890-83b0-12e1c67a2f0c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:58.840239 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4709b-efb5-4890-83b0-12e1c67a2f0c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:58.840315 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4709b-efb5-4890-83b0-12e1c67a2f0c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:58.841944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 329/669] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:58.847320 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86c0b2-a43b-4220-94cc-baa669d7fa61 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:58.847727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86c0b2-a43b-4220-94cc-baa669d7fa61 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:58.847899 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86c0b2-a43b-4220-94cc-baa669d7fa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:58.864784 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-4a86c0b2-a43b-4220-94cc-baa669d7fa61 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:58.865960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-4a86c0b2-a43b-4220-94cc-baa669d7fa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:58.935694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 341/670] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:58.958907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4709b-efb5-4890-83b0-12e1c67a2f0c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:59.063335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4709b-efb5-4890-83b0-12e1c67a2f0c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:59.097671 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f74d0-972e-4c01-a23a-05b30b030e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:59.098684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f74d0-972e-4c01-a23a-05b30b030e44 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:59.099241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f74d0-972e-4c01-a23a-05b30b030e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:59.099741 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f74d0-972e-4c01-a23a-05b30b030e44 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:59.100703 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f74d0-972e-4c01-a23a-05b30b030e44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:59.102360 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f74d0-972e-4c01-a23a-05b30b030e44 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:59.127013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 330/671] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:11:58 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:11:59.354857 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff430-6f16-41af-80a1-c853c871e4f6 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:59.355732 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff430-6f16-41af-80a1-c853c871e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:59.356017 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff430-6f16-41af-80a1-c853c871e4f6 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:59.357670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 342/672] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:11:59.363356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3adb-b14f-441e-9dc2-beab2b18015d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:59.363651 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3adb-b14f-441e-9dc2-beab2b18015d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:59.363935 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3adb-b14f-441e-9dc2-beab2b18015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:59.381662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1e0b3adb-b14f-441e-9dc2-beab2b18015d None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:11:59.382858 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e0b3adb-b14f-441e-9dc2-beab2b18015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:11:59.411065 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:59.460110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 331/673] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:11:59 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:11:59.485729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff430-6f16-41af-80a1-c853c871e4f6 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:59.575203 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:11:59.596501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff430-6f16-41af-80a1-c853c871e4f6 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:59.632551 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:59.633278 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:59.633607 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:59.633884 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:59.645256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:11:59.653707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:11:59.654670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:11:59.655748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:11:59.659352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 343/674] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:11:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:11:59.661225 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b3adb-b14f-441e-9dc2-beab2b18015d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:59.763981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b3adb-b14f-441e-9dc2-beab2b18015d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:59.801454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:59.801454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:59.801454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:59.801454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:59.802235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:11:59.802235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:59.802862 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:59.812411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 332/675] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:11:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:11:59.821849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:11:59.933155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8109c-eb6f-419e-b8e9-b473810ceb37 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:11:59.967928 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:11:59.968743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:11:59.969020 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:11:59.969290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:11:59.981330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:11:59.982795 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:11:59.984785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:12:00.000889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:00.001839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:00.003394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:12:00.003394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:12:00.003394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:00.003394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:00.003394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 344/676] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:00.007896 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:00.061413 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:00.115059 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4338d-673d-405e-946b-1eba1c4c1d10 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:00.156225 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187e5ae-385f-42e4-9145-948ba0459f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:00.156912 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e5ae-385f-42e4-9145-948ba0459f6c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.157194 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e5ae-385f-42e4-9145-948ba0459f6c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.157479 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e5ae-385f-42e4-9145-948ba0459f6c None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.158208 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187e5ae-385f-42e4-9145-948ba0459f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:00.158517 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187e5ae-385f-42e4-9145-948ba0459f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:00.159956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187e5ae-385f-42e4-9145-948ba0459f6c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:00.172523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 333/677] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:00.177757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:00.285240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5f66f-4b4b-4df2-99be-f424193f1023 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:00.332912 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40465bd0-139c-4016-99e9-2ae3e4c04734 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.333564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40465bd0-139c-4016-99e9-2ae3e4c04734 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.333741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:00.334291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40465bd0-139c-4016-99e9-2ae3e4c04734 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.334648 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.335022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.335379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.341479 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 334/678] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:00.343476 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c773b22-e95b-4f9b-972a-a09962254f15 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.343989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c773b22-e95b-4f9b-972a-a09962254f15 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.344375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c773b22-e95b-4f9b-972a-a09962254f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.345252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:00.346975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:12:00.363060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:00.364276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 10:12:00.365462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:00.366204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1c773b22-e95b-4f9b-972a-a09962254f15 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:00.367906 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1c773b22-e95b-4f9b-972a-a09962254f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:00.368290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 345/679] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 10:12:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:00.374788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:00.449501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:00.463319 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 335/680] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:00 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 10:12:00.488957 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c773b22-e95b-4f9b-972a-a09962254f15 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:00.504249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:00.508893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0900-768b-4375-a00c-7fcdc8dcbff8 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:00.545394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77177ed4-7e0c-4830-a85c-da6dd9c168d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:00.545849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77177ed4-7e0c-4830-a85c-da6dd9c168d1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.546135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77177ed4-7e0c-4830-a85c-da6dd9c168d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.546410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77177ed4-7e0c-4830-a85c-da6dd9c168d1 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.547258 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77177ed4-7e0c-4830-a85c-da6dd9c168d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:00.547610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77177ed4-7e0c-4830-a85c-da6dd9c168d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:00.549067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77177ed4-7e0c-4830-a85c-da6dd9c168d1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:00.572013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 346/681] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 10:12:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:12:00.572013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25ba6-7d92-4997-a2a6-079710d13675 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.572013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25ba6-7d92-4997-a2a6-079710d13675 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.572013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af25ba6-7d92-4997-a2a6-079710d13675 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.572013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 347/682] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:00.576003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25ba6-7d92-4997-a2a6-079710d13675 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:00.598582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c773b22-e95b-4f9b-972a-a09962254f15 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:00.634612 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfbb86-626b-4e2c-b301-0097ed447991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:00.635262 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfbb86-626b-4e2c-b301-0097ed447991 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.635569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfbb86-626b-4e2c-b301-0097ed447991 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.635899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfbb86-626b-4e2c-b301-0097ed447991 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.636608 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfbb86-626b-4e2c-b301-0097ed447991 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:00.637982 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfbb86-626b-4e2c-b301-0097ed447991 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:00.652876 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 336/683] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:12:00 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:12:00.661378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bf23c-c238-4d31-82a4-447327d7d523 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.661875 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bf23c-c238-4d31-82a4-447327d7d523 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.662173 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0bf23c-c238-4d31-82a4-447327d7d523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.687322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8c0bf23c-c238-4d31-82a4-447327d7d523 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:00.690010 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8c0bf23c-c238-4d31-82a4-447327d7d523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:00.714696 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af25ba6-7d92-4997-a2a6-079710d13675 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:00.729723 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:00.768133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:00.769027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.769365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.769689 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.785522 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:00.787459 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:00.791466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 337/684] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:00 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:12:00.815981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:00.816918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:00.818254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:12:00.818254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:12:00.818254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:00.818254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:00.818254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 348/685] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:00.827302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bf23c-c238-4d31-82a4-447327d7d523 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:00.827302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:00.832014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:00.955735 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0bf23c-c238-4d31-82a4-447327d7d523 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:00.964741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4a11f-c7b3-4b6a-9189-0df91a720500 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:00.994035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:00.995502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:00.995804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:00.996084 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:00.996826 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:00.997391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:00.999565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:01.006655 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:01.007493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.008339 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.008617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.009351 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:01.013521 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 338/686] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:01.014072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:01.019390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:01.032533 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 349/687] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:12:00 2022] POST /identity/v3/services => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:12:01.095328 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:01.141189 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c6d4c-69d2-4cd5-b567-9432c5a4605c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:01.186320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:01.187150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.187467 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.187742 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.196004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:01.197539 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:12:01.213522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:01.215582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:01.216527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 339/688] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:01.221240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:01.249645 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:01.340958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bda4a-14d0-4397-929b-1d3a096d0ccb None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:01.378839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502bc36-9ba9-42e1-a1e8-8199a9f76b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:01.379472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bc36-9ba9-42e1-a1e8-8199a9f76b58 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.379758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bc36-9ba9-42e1-a1e8-8199a9f76b58 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.380034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502bc36-9ba9-42e1-a1e8-8199a9f76b58 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.380933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502bc36-9ba9-42e1-a1e8-8199a9f76b58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:01.381252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502bc36-9ba9-42e1-a1e8-8199a9f76b58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:01.382709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502bc36-9ba9-42e1-a1e8-8199a9f76b58 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:01.396493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 350/689] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:01.402380 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:01.509176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7e39-96db-4433-a33b-d8d7c37f4cb1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:01.510750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bf70d-b59b-482d-a85b-8351980d38a2 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.511082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bf70d-b59b-482d-a85b-8351980d38a2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.511384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bf70d-b59b-482d-a85b-8351980d38a2 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.513058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 351/690] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:01.518320 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8ad8-bca8-4453-bbcf-4617ae62f42a None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.518870 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8ad8-bca8-4453-bbcf-4617ae62f42a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.519377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8ad8-bca8-4453-bbcf-4617ae62f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.532230 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:01.539244 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-3aea8ad8-bca8-4453-bbcf-4617ae62f42a None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:01.540463 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-3aea8ad8-bca8-4453-bbcf-4617ae62f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:01.557265 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:01.558787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.559726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.560238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] PATH_INFO: `/v3/projects/061cceafef044884ad92a96749c79856/users/245c6d51f8224624be6289a20874b5b1/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.563381 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=061cceafef044884ad92a96749c79856, user_id=245c6d51f8224624be6289a20874b5b1, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:01.565605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:01.587943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 340/691] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:12:01 2022] PUT /identity/v3/projects/061cceafef044884ad92a96749c79856/users/245c6d51f8224624be6289a20874b5b1/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:12:01.645692 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 352/692] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:12:01.671000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:01.787001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7794-bdee-4b39-92a3-b34e4d561d00 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:01.823416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:01.825487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.825487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.825487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] PATH_INFO: `/v3/services/image` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.825842 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:01.827223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:01.839632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:01.840724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:01.842001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 341/693] 10.222.0.67 () {56 vars in 1105 bytes} [Wed May 25 10:12:01 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:01.848660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8ad8-bca8-4453-bbcf-4617ae62f42a None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:01.861013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:01.956891 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8ad8-bca8-4453-bbcf-4617ae62f42a None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:01.992542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:01.993311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:01.993473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:01.993745 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:01.994519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] RBAC: Adding query filter params (name=image) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:01.994837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:01.996521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:02.002033 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 353/694] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:02.007689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:02.055050 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:02.114561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c094ed-42f4-4a93-a37d-33037a19cd40 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:02.149133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:02.149806 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:02.150139 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:02.150419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:02.151128 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] RBAC: Adding query filter params (type=image) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:02.151528 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:02.153098 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:02.158398 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 342/695] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:02.164179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:02.242911 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:02.269818 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8c66-2775-4b34-a0e2-a869eb1d9438 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:02.307071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b5f16-f577-4de9-8965-5afab7fc85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:02.307812 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5f16-f577-4de9-8965-5afab7fc85ea None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:02.308094 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5f16-f577-4de9-8965-5afab7fc85ea None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:02.308368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5f16-f577-4de9-8965-5afab7fc85ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:02.309155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b5f16-f577-4de9-8965-5afab7fc85ea None admin] RBAC: Adding query filter params (interface=public, service_id=adecc00b34284b6a81ca25e1d80c49a7, region_id=RegionOne) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:02.309461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b5f16-f577-4de9-8965-5afab7fc85ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:02.310898 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b5f16-f577-4de9-8965-5afab7fc85ea None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:02.319424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 354/696] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 10:12:02 2022] GET /identity/v3/endpoints?service_id=adecc00b34284b6a81ca25e1d80c49a7&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:02.325070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:02.432658 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780e5b-6257-47c6-ba9a-8894d8dca93c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:02.440854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:02.473900 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026633a4-d037-4b7a-90fb-9dd407a4d23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:02.474581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026633a4-d037-4b7a-90fb-9dd407a4d23a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:02.474867 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026633a4-d037-4b7a-90fb-9dd407a4d23a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:02.475146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026633a4-d037-4b7a-90fb-9dd407a4d23a None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:02.475882 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026633a4-d037-4b7a-90fb-9dd407a4d23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:02.477275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026633a4-d037-4b7a-90fb-9dd407a4d23a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:02.483338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 343/697] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 10:12:02 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:12:03.145098 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e8b2e-0a87-4787-bf46-e75eb46a0c13 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.145613 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e8b2e-0a87-4787-bf46-e75eb46a0c13 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.145920 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e8b2e-0a87-4787-bf46-e75eb46a0c13 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.147823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 355/698] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:03.153291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d77566-7740-4bba-b179-67c57c54b691 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.153752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d77566-7740-4bba-b179-67c57c54b691 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.154051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d77566-7740-4bba-b179-67c57c54b691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.171531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-19d77566-7740-4bba-b179-67c57c54b691 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:03.172729 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-19d77566-7740-4bba-b179-67c57c54b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:03.246784 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 344/699] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:03.271380 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e8b2e-0a87-4787-bf46-e75eb46a0c13 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.383265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e8b2e-0a87-4787-bf46-e75eb46a0c13 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:03.419228 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd171bd-c555-4588-a0a6-b4b8b5b21cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:03.420012 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd171bd-c555-4588-a0a6-b4b8b5b21cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.420290 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd171bd-c555-4588-a0a6-b4b8b5b21cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.420560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd171bd-c555-4588-a0a6-b4b8b5b21cc0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.421214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd171bd-c555-4588-a0a6-b4b8b5b21cc0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:03.422588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd171bd-c555-4588-a0a6-b4b8b5b21cc0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-7fd171bd-c555-4588-a0a6-b4b8b5b21cc0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:03.435285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:03.437536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:03.439084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 356/700] 10.222.0.67 () {56 vars in 1129 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:03.444264 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d77566-7740-4bba-b179-67c57c54b691 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.451637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7e62-5425-4094-805a-c18a32142d4b None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.451922 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7e62-5425-4094-805a-c18a32142d4b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.452196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c7e62-5425-4094-805a-c18a32142d4b None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.453803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 357/701] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:12:03.458784 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6cc8-9d6b-4e6d-aa86-7eb534556842 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.459068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6cc8-9d6b-4e6d-aa86-7eb534556842 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.459408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6cc8-9d6b-4e6d-aa86-7eb534556842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.464663 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:03.478355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-4a4d6cc8-9d6b-4e6d-aa86-7eb534556842 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:03.479705 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-4a4d6cc8-9d6b-4e6d-aa86-7eb534556842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:03.546381 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:03.550520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d77566-7740-4bba-b179-67c57c54b691 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:03.556808 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 358/702] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:12:03.580972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6cc8-9d6b-4e6d-aa86-7eb534556842 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.594876 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:03.595600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.595887 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.596161 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.596883 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:03.597196 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:03.598592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:03.603933 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 345/703] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:12:03.610096 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.690440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6cc8-9d6b-4e6d-aa86-7eb534556842 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:03.717806 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b0bd7-7649-458d-8f81-f14967a45eec None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:03.721408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:03.727994 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:03.728819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.729100 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.729373 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] PATH_INFO: `/v3/services/network` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.730128 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:03.731699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:03.744352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:03.746951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:12:03.749044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:03.759330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 359/704] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:12:03.759330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.760927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:03.762233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.762725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.763189 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.764058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:03.764374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:03.765832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:03.776881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 346/705] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:03.777940 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.814301 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:03.865327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aa8bc-1072-49e3-8a02-a75bc88be59c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:03.895711 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39201110-39c7-49f7-a6c9-2aff0072105f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:03.902053 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:03.902734 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.903015 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.903313 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.904131 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] RBAC: Adding query filter params (name=network) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:03.904443 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:03.905947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:03.915846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 360/706] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:03.916783 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.931766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:03.932452 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:03.932786 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:03.933066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:03.933867 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] RBAC: Adding query filter params (interface=public, service_id=21dbd4d9605746c093ea8f6ac67d45ec, region_id=RegionOne) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:03.934181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:03.935617 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:03.948683 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 347/707] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/endpoints?service_id=21dbd4d9605746c093ea8f6ac67d45ec&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:03.949538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:03.985452 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:04.029230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92cd17-b9d4-4c30-bcab-21c94622e01d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:04.048638 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:04.059694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3737c09-56d8-4364-bd25-7b7bb075b78a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:04.068812 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8d26d-8e5e-4406-92a1-1cce16328a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:04.069509 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8d26d-8e5e-4406-92a1-1cce16328a1a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.069785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8d26d-8e5e-4406-92a1-1cce16328a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.070068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8d26d-8e5e-4406-92a1-1cce16328a1a None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.070801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8d26d-8e5e-4406-92a1-1cce16328a1a None admin] RBAC: Adding query filter params (type=network) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:04.071115 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8d26d-8e5e-4406-92a1-1cce16328a1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:04.072588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8d26d-8e5e-4406-92a1-1cce16328a1a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:04.079906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 361/708] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:04.081253 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbafaf-1ca2-4a7b-9d82-f61c352653d2 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.081540 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbafaf-1ca2-4a7b-9d82-f61c352653d2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.081817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbafaf-1ca2-4a7b-9d82-f61c352653d2 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.083815 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 362/709] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:04.090211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aebfe-7f91-4f01-864a-ede9fa181ab5 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.090562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aebfe-7f91-4f01-864a-ede9fa181ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.090911 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aebfe-7f91-4f01-864a-ede9fa181ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.097887 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:04.098559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.098843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.099115 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.099828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:04.101207 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:04.115369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 348/710] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 10:12:03 2022] GET /identity/v3/services => generated 1002 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:12:04.115369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:04.115664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-cd9aebfe-7f91-4f01-864a-ede9fa181ab5 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:04.115664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-cd9aebfe-7f91-4f01-864a-ede9fa181ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:04.212257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 363/711] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:04 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:04.238742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aebfe-7f91-4f01-864a-ede9fa181ab5 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:04.246459 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf7d1-d7ea-4e06-ae7d-66e6430551db None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:04.286044 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:04.287019 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.287485 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.287942 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.289021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] RBAC: Adding query filter params (interface=public, service_id=c79a88f828df4d19b579459a13e5efbf, region_id=RegionOne) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:04.289561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:04.291326 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:04.298143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 349/712] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 10:12:04 2022] GET /identity/v3/endpoints?service_id=c79a88f828df4d19b579459a13e5efbf&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:04.303855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:04.313753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:04.357497 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:04.390522 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aebfe-7f91-4f01-864a-ede9fa181ab5 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:04.446565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:04.447785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.448384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.448553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.466165 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286031c0-7bc9-4a91-992d-303d2548dbcc None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:04.466355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:12:04.474413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:04.475508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:04.476348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 364/713] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:12:04.486297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:04.506574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:04.507260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.507596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.507878 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.508581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:04.510009 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:04.521930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 350/714] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 10:12:04 2022] GET /identity/v3/services => generated 1002 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 10:12:04.625023 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5afe0-9f68-4400-a870-7de06eacc922 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:04.642133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:04.666231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4ecf8-a755-4115-a637-d5092d8d3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:04.667035 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4ecf8-a755-4115-a637-d5092d8d3023 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.667415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4ecf8-a755-4115-a637-d5092d8d3023 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.667686 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4ecf8-a755-4115-a637-d5092d8d3023 None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.668508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4ecf8-a755-4115-a637-d5092d8d3023 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:04.668826 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4ecf8-a755-4115-a637-d5092d8d3023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:04.670324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4ecf8-a755-4115-a637-d5092d8d3023 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:04.681158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 365/715] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:04.687407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:04.795748 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:04.805656 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c50521-48c5-450c-a958-56d2e49ad449 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:04.843998 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:04.844818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.845106 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.845391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.857220 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:04.858717 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:12:04.876772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:04.877710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:04.878603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:12:04.878603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:12:04.878603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:04.878603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:04.878603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 351/716] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:04.885206 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0027f-82a0-4699-94e4-2814c35edda0 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.885505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0027f-82a0-4699-94e4-2814c35edda0 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.886239 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0027f-82a0-4699-94e4-2814c35edda0 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.886823 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:04.888022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 366/717] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:04.894378 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ef17c-18f7-44ac-b662-c47411388a53 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:04.894719 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ef17c-18f7-44ac-b662-c47411388a53 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:04.895007 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ef17c-18f7-44ac-b662-c47411388a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:04.915606 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-447ef17c-18f7-44ac-b662-c47411388a53 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:04.917437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-447ef17c-18f7-44ac-b662-c47411388a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:04.998341 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9cfb7-de8e-43c4-8b0d-b4a4a73705d1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.007427 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 367/718] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:04 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:12:05.031385 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ef17c-18f7-44ac-b662-c47411388a53 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.045011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.045853 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.046092 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.054299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.054299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:05.054299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.054299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.056783 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:05.064810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 352/719] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:05.071895 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.157720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ef17c-18f7-44ac-b662-c47411388a53 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.165656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:05.200343 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.201150 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.201433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.201715 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] PATH_INFO: `/v3/services/image` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.202106 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682296-b754-4793-8c92-8f75532b3ebb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.202386 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.203822 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:05.216350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:05.217804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:05.218664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 368/720] 10.222.0.67 () {56 vars in 1105 bytes} [Wed May 25 10:12:05 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:05.227331 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.249211 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.250678 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.251109 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.251557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.260206 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.261930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:12:05.277588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:05.278822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 10:12:05.280055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:05.287104 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 353/721] 10.222.0.67 () {56 vars in 1093 bytes} [Wed May 25 10:12:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:05.288172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.338099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113776-df7a-4d7e-a76a-71620cdf24a6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.349753 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:05.376647 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.377466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.377751 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.378033 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.378757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] RBAC: Adding query filter params (name=image) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:05.379099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.380578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.390520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 369/722] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:12:05.392119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.399408 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd67cd4-25f1-40f1-8a82-9f75748f37b9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.430725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:05.439752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.440763 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.441194 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.441798 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.442842 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:05.443325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.445029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.469366 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 354/723] 10.222.0.67 () {56 vars in 1133 bytes} [Wed May 25 10:12:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:05.470619 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.505218 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a334-47a9-4778-83f3-67c5d6b60e68 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.544251 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.544940 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.545338 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.545614 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.546417 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] RBAC: Adding query filter params (type=image) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:05.547434 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.548316 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.558767 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 370/724] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:05.559948 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.579182 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db7a3-742a-4dd6-b6aa-39b96e220774 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.595385 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:05.618283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.618976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.619349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.619633 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.669589 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:05.673968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448061-805f-4744-a5ef-c905594b6844 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:05.696706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.698178 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.711845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:05.712928 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:05.713362 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:05.713960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:05.714914 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:05.716655 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:05.751880 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 371/725] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 10:12:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:05.832180 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 355/726] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:12:05 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 10:12:05.843673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:05.989014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8088fa-fc7b-4c64-b6a1-f174835f172b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:06.029952 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:06.030991 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.031264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.031264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.051471 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:06.052953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:12:06.071849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:06.072791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:06.074450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:12:06.074450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:12:06.074450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:06.074450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:06.074450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 372/727] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:06.079447 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:06.095687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:06.185529 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dff7c7-0291-4559-8f06-a6f5d695c061 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:06.224647 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:06.225347 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.225650 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.225930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.226665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:06.226976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:06.228659 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:06.247710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 356/728] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:06.255321 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:06.258716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:06.370587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8fe1b-35f6-43dc-8dd6-30925d4784ad None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:06.412644 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c45e5-24eb-4a91-bfee-0d449e29d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:06.413471 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c45e5-24eb-4a91-bfee-0d449e29d6bb None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.413757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c45e5-24eb-4a91-bfee-0d449e29d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.414033 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c45e5-24eb-4a91-bfee-0d449e29d6bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.421994 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c45e5-24eb-4a91-bfee-0d449e29d6bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:06.423562 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c45e5-24eb-4a91-bfee-0d449e29d6bb None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-6c2c45e5-24eb-4a91-bfee-0d449e29d6bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:12:06.439408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:06.440340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:06.441231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 373/729] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:12:06.448425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:06.536277 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:06.562405 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be6028-3ca7-4aec-b481-1479e6ffb3c3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:06.577433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef844f-4c7e-4bdf-968a-f2b6e87460cf None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.577765 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef844f-4c7e-4bdf-968a-f2b6e87460cf None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.578001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef844f-4c7e-4bdf-968a-f2b6e87460cf None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.580739 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 374/730] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:12:06.584652 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e047d60-ccd7-4f00-b7a2-941fb9057464 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.584948 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e047d60-ccd7-4f00-b7a2-941fb9057464 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.585231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e047d60-ccd7-4f00-b7a2-941fb9057464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.606080 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-1e047d60-ccd7-4f00-b7a2-941fb9057464 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:06.607330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-1e047d60-ccd7-4f00-b7a2-941fb9057464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:06.609160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:06.611121 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.611461 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.611746 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.612561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:06.612877 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:06.614344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:06.632418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 357/731] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:06.638782 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:06.676869 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:06.695460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 375/732] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:06 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:12:06.714737 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e047d60-ccd7-4f00-b7a2-941fb9057464 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:06.773109 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1853168-0255-4a38-811e-46aa1104ace9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:06.813702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:06.814306 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.814739 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.815036 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.816378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=061cceafef044884ad92a96749c79856, user.id=245c6d51f8224624be6289a20874b5b1) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:06.816834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:06.818797 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:06.824070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:06.826711 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 358/733] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:12:06 2022] GET /identity/v3/role_assignments?user.id=245c6d51f8224624be6289a20874b5b1&scope.project.id=061cceafef044884ad92a96749c79856&role.id=079434fe84194c03ae64e10d61e222e6 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:06.827163 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e047d60-ccd7-4f00-b7a2-941fb9057464 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:06.872045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fdc1cc-4ffd-4950-b049-28eaf013efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:06.872903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdc1cc-4ffd-4950-b049-28eaf013efd0 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.873188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdc1cc-4ffd-4950-b049-28eaf013efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.873467 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fdc1cc-4ffd-4950-b049-28eaf013efd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.874145 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdc1cc-4ffd-4950-b049-28eaf013efd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:06.875676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fdc1cc-4ffd-4950-b049-28eaf013efd0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-69fdc1cc-4ffd-4950-b049-28eaf013efd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:06.889324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:06.890346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 10:12:06.891175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:06.895430 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 376/734] 10.222.0.67 () {56 vars in 1129 bytes} [Wed May 25 10:12:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:12:06.898787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:06.914449 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c5c1-5265-40e9-a0b3-d7c1744de788 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.914803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c5c1-5265-40e9-a0b3-d7c1744de788 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.914979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66c5c1-5265-40e9-a0b3-d7c1744de788 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.916769 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 377/735] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:12:06.923115 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09031-3575-48eb-b9c5-f68554e93e20 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:06.923453 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09031-3575-48eb-b9c5-f68554e93e20 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:06.923699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09031-3575-48eb-b9c5-f68554e93e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:06.942235 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-64c09031-3575-48eb-b9c5-f68554e93e20 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:06.943896 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-64c09031-3575-48eb-b9c5-f68554e93e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:07.002804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:07.013038 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d508a1-1f3c-462b-8734-cc3a39a9c5c1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:07.023688 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 378/736] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:06 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:07.047702 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c09031-3575-48eb-b9c5-f68554e93e20 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:07.054349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:07.055039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:07.055367 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:07.055654 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:07.056499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:07.056818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:07.058323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:07.068840 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 359/737] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 10:12:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:07.070012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:07.145439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:07.163405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c09031-3575-48eb-b9c5-f68554e93e20 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:07.188200 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17feaedc-6142-416f-8b07-f233c6bd95a6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:07.201230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:07.202344 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:07.202797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:07.203241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] PATH_INFO: `/v3/services/network` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:07.204119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:07.205679 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:07.219411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:07.220424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 10:12:07.221230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:07.223674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 379/738] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:07 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:12:07.229983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:07.229983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:07.229983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:07.229983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:07.230387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:07.230387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:07.230387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:07.231705 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:07.234603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 360/739] 10.222.0.67 () {56 vars in 1124 bytes} [Wed May 25 10:12:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:07.239821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:07.285796 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:07.338915 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33dcd5e-600f-4162-9574-e43c80eef44f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:07.354760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55d42-14de-4b44-911b-432b23693b7c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:07.374166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:07.375158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:07.375648 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:07.376095 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:07.376976 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] RBAC: Adding query filter params (name=network) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:07.377454 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:07.379049 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:07.383385 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:07.388071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 380/740] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:07.391198 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:07.394365 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:07.395072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:07.396197 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:07.396197 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:07.396508 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:07.397896 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:07.425624 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 361/741] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 10:12:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:12:07.521485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6c75d-cbb4-4c25-aa59-bc02c30ac48f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:07.538387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:07.568797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b5057-bcf3-41f5-987f-0c189e32adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:07.569784 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b5057-bcf3-41f5-987f-0c189e32adce None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:07.570227 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b5057-bcf3-41f5-987f-0c189e32adce None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:07.570681 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b5057-bcf3-41f5-987f-0c189e32adce None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:07.571599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b5057-bcf3-41f5-987f-0c189e32adce None admin] RBAC: Adding query filter params (type=network) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:07.572059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b5057-bcf3-41f5-987f-0c189e32adce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:07.573729 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b5057-bcf3-41f5-987f-0c189e32adce None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:07.580025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 381/742] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:12:07.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:07.699927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0242349-f636-48d0-ace7-ce688170154b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:07.734260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f3fef-ca7b-4359-a427-853fae14a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:07.734935 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3fef-ca7b-4359-a427-853fae14a189 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:07.735224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3fef-ca7b-4359-a427-853fae14a189 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:07.735532 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f3fef-ca7b-4359-a427-853fae14a189 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:07.736278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f3fef-ca7b-4359-a427-853fae14a189 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:07.737692 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f3fef-ca7b-4359-a427-853fae14a189 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:07.760125 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 362/743] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 10:12:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:08.342466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611a6c-1b71-4722-b38d-537c4b98ac0d None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:08.343014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611a6c-1b71-4722-b38d-537c4b98ac0d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:08.343014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9611a6c-1b71-4722-b38d-537c4b98ac0d None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:08.344411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 382/744] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:08.350136 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47206-c348-44c0-b70b-75ca92c62b39 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:08.350478 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47206-c348-44c0-b70b-75ca92c62b39 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:08.350727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47206-c348-44c0-b70b-75ca92c62b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:08.368188 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dbd47206-c348-44c0-b70b-75ca92c62b39 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:08.369390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dbd47206-c348-44c0-b70b-75ca92c62b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:08.399522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:08.443893 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 363/745] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:08 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:08.467699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611a6c-1b71-4722-b38d-537c4b98ac0d None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:08.572379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9611a6c-1b71-4722-b38d-537c4b98ac0d None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:08.617774 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:08.618797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:08.619254 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:08.619802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:08.696306 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:08.731126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:08.733121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:08.866493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 383/746] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:12:08 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 10:12:08.872566 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47206-c348-44c0-b70b-75ca92c62b39 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:08.982538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47206-c348-44c0-b70b-75ca92c62b39 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:09.021977 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9613725-a5c3-4a40-a03b-c1426f858cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:09.022796 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613725-a5c3-4a40-a03b-c1426f858cfa None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.023083 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613725-a5c3-4a40-a03b-c1426f858cfa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.023410 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9613725-a5c3-4a40-a03b-c1426f858cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.034949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9613725-a5c3-4a40-a03b-c1426f858cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:09.036600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9613725-a5c3-4a40-a03b-c1426f858cfa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-e9613725-a5c3-4a40-a03b-c1426f858cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:12:09.054960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:09.055996 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:09.056907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:12:09.056907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:12:09.056907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:12:09.056907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:09.056907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 364/747] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:09.065345 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:09.151410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:09.180006 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c102b-d7d7-4f11-b414-307291502eea None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:09.219226 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efd01f-811d-4bd3-beb6-b09356d6dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:09.219931 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efd01f-811d-4bd3-beb6-b09356d6dd93 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.220306 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efd01f-811d-4bd3-beb6-b09356d6dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.220778 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efd01f-811d-4bd3-beb6-b09356d6dd93 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.221974 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efd01f-811d-4bd3-beb6-b09356d6dd93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:09.222450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efd01f-811d-4bd3-beb6-b09356d6dd93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:09.224778 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efd01f-811d-4bd3-beb6-b09356d6dd93 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:09.237215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 384/748] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:12:09.327369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1aaf-de61-4a70-8bea-a834e4544e4c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.327768 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1aaf-de61-4a70-8bea-a834e4544e4c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.327941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb1aaf-de61-4a70-8bea-a834e4544e4c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.329580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 365/749] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:09.337080 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627cfef-d453-4054-b4a3-f8522a184e5d None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.337433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627cfef-d453-4054-b4a3-f8522a184e5d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.337614 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627cfef-d453-4054-b4a3-f8522a184e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.361270 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-3627cfef-d453-4054-b4a3-f8522a184e5d None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:09.362512 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-3627cfef-d453-4054-b4a3-f8522a184e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:09.444846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 385/750] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:09 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:09.477454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb1aaf-de61-4a70-8bea-a834e4544e4c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:09.501939 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:09.604048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb1aaf-de61-4a70-8bea-a834e4544e4c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:09.639826 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:09.640655 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.640940 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.641219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.641878 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:09.643300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:09.655814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:09.656818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:09.657649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 366/751] 10.222.0.67 () {56 vars in 1132 bytes} [Wed May 25 10:12:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:09.666689 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627cfef-d453-4054-b4a3-f8522a184e5d None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:09.734334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:09.776001 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627cfef-d453-4054-b4a3-f8522a184e5d None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:09.811755 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57688e9f-e990-4523-aa9d-2295cdce5ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:09.812433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688e9f-e990-4523-aa9d-2295cdce5ede None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.813033 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688e9f-e990-4523-aa9d-2295cdce5ede None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.813347 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57688e9f-e990-4523-aa9d-2295cdce5ede None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.814102 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688e9f-e990-4523-aa9d-2295cdce5ede None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:09.814414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688e9f-e990-4523-aa9d-2295cdce5ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:09.815839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57688e9f-e990-4523-aa9d-2295cdce5ede None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:09.821092 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 386/752] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 10:12:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:09.826957 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:09.911486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:09.924073 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177f415-882c-437b-a9c2-731d1bb8e458 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.924353 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177f415-882c-437b-a9c2-731d1bb8e458 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.924632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177f415-882c-437b-a9c2-731d1bb8e458 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.926025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 387/753] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:09.931080 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456fe2b-e7c4-4b61-a760-f56100a3a0b6 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.931402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456fe2b-e7c4-4b61-a760-f56100a3a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.931684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456fe2b-e7c4-4b61-a760-f56100a3a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.932217 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a79ec-0492-4336-b494-4d3adcf1a9d8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:09.949637 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-6456fe2b-e7c4-4b61-a760-f56100a3a0b6 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:09.951210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-6456fe2b-e7c4-4b61-a760-f56100a3a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:09.967258 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:09.967978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:09.968269 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:09.968550 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:09.969275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:09.969589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:09.970998 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:09.976201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 367/754] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 10:12:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:10.040767 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 388/755] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:09 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:10.065368 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:10.179049 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e33fb-207e-49af-b98d-64435595837f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:10.213986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:10.214804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:10.215122 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:10.215437 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:10.216087 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:10.217482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:10.229464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:10.230474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:10.231344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 368/756] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:10.238184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456fe2b-e7c4-4b61-a760-f56100a3a0b6 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:10.302950 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:10.350629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456fe2b-e7c4-4b61-a760-f56100a3a0b6 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:10.386304 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c857-1043-4df9-bbcb-78c619a150f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:10.386970 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c857-1043-4df9-bbcb-78c619a150f1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:10.387243 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c857-1043-4df9-bbcb-78c619a150f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:10.387551 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c857-1043-4df9-bbcb-78c619a150f1 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:10.388265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c857-1043-4df9-bbcb-78c619a150f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:10.388580 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c857-1043-4df9-bbcb-78c619a150f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:10.389970 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c857-1043-4df9-bbcb-78c619a150f1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:10.394668 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 389/757] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:10.400532 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:10.412243 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:10.506713 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a5d22-3d77-4301-a07d-ffe8b73f3a59 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:10.543778 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a451-972f-4254-8e5c-05deeaf8809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:10.544449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a451-972f-4254-8e5c-05deeaf8809f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:10.544732 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a451-972f-4254-8e5c-05deeaf8809f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:10.545005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a451-972f-4254-8e5c-05deeaf8809f None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:10.545702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a451-972f-4254-8e5c-05deeaf8809f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:10.546010 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a451-972f-4254-8e5c-05deeaf8809f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:10.547418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a451-972f-4254-8e5c-05deeaf8809f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:10.552165 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 369/758] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:12.221383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cbdce-5258-4829-83e3-7d455df99afa None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:12.221953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cbdce-5258-4829-83e3-7d455df99afa None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:12.221953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cbdce-5258-4829-83e3-7d455df99afa None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:12.223414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 390/759] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:12.229442 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0990-29b2-4138-b544-4bd9d3792317 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:12.229907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0990-29b2-4138-b544-4bd9d3792317 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:12.230117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0990-29b2-4138-b544-4bd9d3792317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:12.249544 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-e34f0990-29b2-4138-b544-4bd9d3792317 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:12.250750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e34f0990-29b2-4138-b544-4bd9d3792317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:12.326024 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 370/760] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:12 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:12.351069 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cbdce-5258-4829-83e3-7d455df99afa None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:12.479079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cbdce-5258-4829-83e3-7d455df99afa None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:12.513089 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:12.527127 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74795a4c-1a58-4e44-a8d7-7be3e4df4102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:12.527838 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74795a4c-1a58-4e44-a8d7-7be3e4df4102 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:12.528120 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74795a4c-1a58-4e44-a8d7-7be3e4df4102 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:12.528391 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74795a4c-1a58-4e44-a8d7-7be3e4df4102 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:12.529372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74795a4c-1a58-4e44-a8d7-7be3e4df4102 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:12.530767 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74795a4c-1a58-4e44-a8d7-7be3e4df4102 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:12.546230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 391/761] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:12:12 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:12.891158 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4425ed-d571-4357-b084-de880798d2e9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:12.891561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4425ed-d571-4357-b084-de880798d2e9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:12.891846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4425ed-d571-4357-b084-de880798d2e9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:12.893238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 371/762] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:12.898859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad323e6-1190-4a38-adcf-ec4a9d328fe9 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:12.899149 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad323e6-1190-4a38-adcf-ec4a9d328fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:12.899460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad323e6-1190-4a38-adcf-ec4a9d328fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:12.918043 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-aad323e6-1190-4a38-adcf-ec4a9d328fe9 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:12.919243 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-aad323e6-1190-4a38-adcf-ec4a9d328fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:12.996969 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 392/763] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:12 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:13.020593 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4425ed-d571-4357-b084-de880798d2e9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:13.023854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:13.130817 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4425ed-d571-4357-b084-de880798d2e9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:13.165664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b3c8b-38a1-4b2e-8ae6-f5bcc0205cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:13.166335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b3c8b-38a1-4b2e-8ae6-f5bcc0205cb3 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:13.166642 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b3c8b-38a1-4b2e-8ae6-f5bcc0205cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:13.166930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b3c8b-38a1-4b2e-8ae6-f5bcc0205cb3 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:13.167811 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b3c8b-38a1-4b2e-8ae6-f5bcc0205cb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:13.169229 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b3c8b-38a1-4b2e-8ae6-f5bcc0205cb3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:13.184878 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 372/764] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:12:13 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:14.842294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411fcfb-e625-4a5f-b893-0c0f21c3ee88 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:14.842771 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411fcfb-e625-4a5f-b893-0c0f21c3ee88 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:14.842880 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411fcfb-e625-4a5f-b893-0c0f21c3ee88 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:14.844256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 393/765] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:14.849600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275e6f-9a9e-482e-83a7-3ded36d021ed None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:14.850025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275e6f-9a9e-482e-83a7-3ded36d021ed None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:14.850137 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1275e6f-9a9e-482e-83a7-3ded36d021ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:14.868410 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d1275e6f-9a9e-482e-83a7-3ded36d021ed None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:14.869628 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d1275e6f-9a9e-482e-83a7-3ded36d021ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:14.929116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:14.946820 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 373/766] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:14 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:14.971039 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411fcfb-e625-4a5f-b893-0c0f21c3ee88 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:15.080996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411fcfb-e625-4a5f-b893-0c0f21c3ee88 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:15.090443 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:15.116635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:15.117481 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.117728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.117997 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.118644 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:15.120063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:15.132214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:15.133284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:15.140878 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 394/767] 10.222.0.67 () {56 vars in 1132 bytes} [Wed May 25 10:12:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:15.143387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275e6f-9a9e-482e-83a7-3ded36d021ed None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:15.251635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1275e6f-9a9e-482e-83a7-3ded36d021ed None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:15.291768 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:15.292463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.292748 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.293024 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.293759 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:15.294074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:15.295588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:15.301280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 374/768] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 10:12:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:15.307463 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:15.416824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924858f6-e8d9-4157-9c43-caace654802f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:15.451941 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb4ae5-1e0b-4179-998a-9e090f7cf352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:15.452608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb4ae5-1e0b-4179-998a-9e090f7cf352 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.452892 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb4ae5-1e0b-4179-998a-9e090f7cf352 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.453165 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb4ae5-1e0b-4179-998a-9e090f7cf352 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.453874 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb4ae5-1e0b-4179-998a-9e090f7cf352 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:15.454184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb4ae5-1e0b-4179-998a-9e090f7cf352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:15.455602 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb4ae5-1e0b-4179-998a-9e090f7cf352 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:15.460514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 395/769] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 10:12:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:15.466721 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:15.475914 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826d77-8aac-46dc-ae84-500907a38329 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.476207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826d77-8aac-46dc-ae84-500907a38329 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.476489 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826d77-8aac-46dc-ae84-500907a38329 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.477809 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 396/770] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:12:15.482886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee9d2-f2c3-457c-bca5-243fb0cd66c6 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.483171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee9d2-f2c3-457c-bca5-243fb0cd66c6 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.483487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ee9d2-f2c3-457c-bca5-243fb0cd66c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.499955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-3f3ee9d2-f2c3-457c-bca5-243fb0cd66c6 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:15.501180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-3f3ee9d2-f2c3-457c-bca5-243fb0cd66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:15.523093 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:15.531249 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:15.570774 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da17633-8c4b-428d-af73-aadac6d28062 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:15.571752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 397/771] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:12:15.595312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ee9d2-f2c3-457c-bca5-243fb0cd66c6 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:15.605402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:15.606075 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.606354 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.606627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.607455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] RBAC: Adding query filter params (interface=public, service_id=ce2ee3b415724bd6b410d95eed1d5bf4, region_id=RegionOne) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:15.607773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:15.609164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:15.614381 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 375/772] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 10:12:15 2022] GET /identity/v3/endpoints?service_id=ce2ee3b415724bd6b410d95eed1d5bf4&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:15.620041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:15.699058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ee9d2-f2c3-457c-bca5-243fb0cd66c6 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:15.721699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372ded6-b770-4228-b059-edd17970c8fa None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:15.734851 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:15.735708 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.736526 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.736961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.737778 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:15.739175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:15.740710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:15.752492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:15.753578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:15.754776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 398/773] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:15.761608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:15.765098 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:15.765774 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.766062 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.766345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.767041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:15.768460 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:15.774850 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 376/774] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 10:12:15 2022] GET /identity/v3/services => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:12:15.793389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:15.871762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ba07-f054-4c98-b661-e6a1cea9d163 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:15.909228 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:15.909919 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:15.910204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:15.910476 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:15.911206 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:15.911550 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:15.912960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:15.918925 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 399/775] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:15.925182 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:16.031078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfec77-8613-42d1-8766-450395fa2132 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:16.071250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:16.071955 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:16.072239 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:16.072511 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:16.073871 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:16.074181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:16.075616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:16.080533 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 377/776] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:16.087097 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:16.184318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:16.193900 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01494c7d-5d79-4df0-9703-f142224114d1 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:16.229405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4b394-462a-4073-9b4c-3573f502b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:16.230072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4b394-462a-4073-9b4c-3573f502b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:16.230355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4b394-462a-4073-9b4c-3573f502b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:16.230632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4b394-462a-4073-9b4c-3573f502b9a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:16.231469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4b394-462a-4073-9b4c-3573f502b9a2 None admin] RBAC: Adding query filter params (interface=public, service_id=7918b359516b4c2fada3a7e61b9b4ff6, region_id=RegionOne) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:16.231788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4b394-462a-4073-9b4c-3573f502b9a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:16.233177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4b394-462a-4073-9b4c-3573f502b9a2 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:16.238545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 400/777] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 10:12:16 2022] GET /identity/v3/endpoints?service_id=7918b359516b4c2fada3a7e61b9b4ff6&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:16.244569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:16.294102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:16.354776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545721e8-34b9-420a-938c-21ddef10f715 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:16.391323 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2d6ec-06d8-4e74-a757-48dc16c29826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:16.391997 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d6ec-06d8-4e74-a757-48dc16c29826 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:16.392286 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d6ec-06d8-4e74-a757-48dc16c29826 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:16.392568 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2d6ec-06d8-4e74-a757-48dc16c29826 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:16.393254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2d6ec-06d8-4e74-a757-48dc16c29826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:16.394666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2d6ec-06d8-4e74-a757-48dc16c29826 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:16.411308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 378/778] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 10:12:16 2022] GET /identity/v3/services => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:12:18.262031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198299-2bf4-4dd1-92d2-666fc6c698f8 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:18.262031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198299-2bf4-4dd1-92d2-666fc6c698f8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:18.262031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68198299-2bf4-4dd1-92d2-666fc6c698f8 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:18.265244 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 401/779] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:18.269382 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a86a-337f-45d7-b90b-9faa687e12d6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:18.269852 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a86a-337f-45d7-b90b-9faa687e12d6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:18.269946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190a86a-337f-45d7-b90b-9faa687e12d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:18.288066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-1190a86a-337f-45d7-b90b-9faa687e12d6 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:18.289239 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1190a86a-337f-45d7-b90b-9faa687e12d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:18.358377 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 379/780] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:12:18.383321 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198299-2bf4-4dd1-92d2-666fc6c698f8 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:18.496000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68198299-2bf4-4dd1-92d2-666fc6c698f8 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:18.533684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:18.534434 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:18.534714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:18.534993 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:18.535673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:18.537055 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:18.550126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:18.551123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:18.552240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 402/781] 10.222.0.67 () {56 vars in 1132 bytes} [Wed May 25 10:12:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:18.559540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a86a-337f-45d7-b90b-9faa687e12d6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:18.601846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:18.664550 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190a86a-337f-45d7-b90b-9faa687e12d6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:18.701727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:18.702400 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:18.702685 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:18.702953 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:18.703705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:18.704017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:18.705414 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:18.710238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 380/782] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 10:12:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:18.716761 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:18.744082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:18.825172 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253b70f-f299-4f23-bbba-12d94f3efdb5 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:18.860754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66e23-a5cb-4644-9217-bc80d0b0dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:18.861481 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66e23-a5cb-4644-9217-bc80d0b0dbd2 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:18.861766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66e23-a5cb-4644-9217-bc80d0b0dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:18.862044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66e23-a5cb-4644-9217-bc80d0b0dbd2 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:18.862777 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd66e23-a5cb-4644-9217-bc80d0b0dbd2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:18.863089 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd66e23-a5cb-4644-9217-bc80d0b0dbd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:18.864544 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd66e23-a5cb-4644-9217-bc80d0b0dbd2 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:18.870546 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 403/783] 10.222.0.67 () {56 vars in 1126 bytes} [Wed May 25 10:12:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:18.876681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:18.981692 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb31074-9e52-4bc9-aea6-dc7f1a4c87c2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:18.983236 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:19.017307 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1049-d972-496e-81b0-6b2c58912081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:19.017978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1049-d972-496e-81b0-6b2c58912081 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:19.018263 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1049-d972-496e-81b0-6b2c58912081 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:19.018539 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1049-d972-496e-81b0-6b2c58912081 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:19.019311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1049-d972-496e-81b0-6b2c58912081 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:19.020707 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1049-d972-496e-81b0-6b2c58912081 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:19.040841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 381/784] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 10:12:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:19.186627 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261edb-fc58-4988-a757-cecbbc812590 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:19.186877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261edb-fc58-4988-a757-cecbbc812590 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:19.187178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22261edb-fc58-4988-a757-cecbbc812590 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:19.188987 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 404/785] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:19.195203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0b279-6736-4211-9e57-d0c498c0e72c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:19.195504 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0b279-6736-4211-9e57-d0c498c0e72c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:19.195815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0b279-6736-4211-9e57-d0c498c0e72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:19.214754 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-a0e0b279-6736-4211-9e57-d0c498c0e72c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:19.216052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-a0e0b279-6736-4211-9e57-d0c498c0e72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:19.299897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 382/786] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:19 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:19.327719 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261edb-fc58-4988-a757-cecbbc812590 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:19.428135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:19.447531 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22261edb-fc58-4988-a757-cecbbc812590 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:19.481851 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:19.482652 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:19.482927 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:19.483195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:19.483881 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:19.485256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:19.496877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:19.497871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:19.498750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 405/787] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:19.505984 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0b279-6736-4211-9e57-d0c498c0e72c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:19.596470 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:19.614769 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0b279-6736-4211-9e57-d0c498c0e72c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:19.652261 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:19.653049 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:19.653436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:19.653767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:19.654640 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:19.654963 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:19.656732 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:19.662753 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 383/788] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:19.669418 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:19.782125 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0583642e-0e78-4733-a6d3-daf91b979f57 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:19.816516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705084c-f27f-4b3b-9e93-b714f1283cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:19.817194 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705084c-f27f-4b3b-9e93-b714f1283cd7 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:19.817478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705084c-f27f-4b3b-9e93-b714f1283cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:19.817756 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705084c-f27f-4b3b-9e93-b714f1283cd7 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:19.818479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705084c-f27f-4b3b-9e93-b714f1283cd7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:19.818790 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705084c-f27f-4b3b-9e93-b714f1283cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:19.820274 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705084c-f27f-4b3b-9e93-b714f1283cd7 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:19.829048 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 406/789] 10.222.0.67 () {56 vars in 1114 bytes} [Wed May 25 10:12:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:19.835112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:19.944318 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ddef8-db60-4857-8179-0bd74daadae8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:19.983166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7f906-9476-4b51-9063-e5fe40bb93eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:19.984083 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f906-9476-4b51-9063-e5fe40bb93eb None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:19.984455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f906-9476-4b51-9063-e5fe40bb93eb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:19.984876 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7f906-9476-4b51-9063-e5fe40bb93eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:19.985892 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7f906-9476-4b51-9063-e5fe40bb93eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:19.987694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7f906-9476-4b51-9063-e5fe40bb93eb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:20.011653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 384/790] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 10:12:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:21.440779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffd9cf-3228-4ad2-94ae-04402811f048 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:21.441312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffd9cf-3228-4ad2-94ae-04402811f048 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:21.441423 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffd9cf-3228-4ad2-94ae-04402811f048 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:21.442742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 407/791] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:21.448241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec80c7-91d0-4912-aeca-446f6b6fe3eb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:21.448697 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec80c7-91d0-4912-aeca-446f6b6fe3eb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:21.448799 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec80c7-91d0-4912-aeca-446f6b6fe3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:21.454905 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:21.471057 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-16ec80c7-91d0-4912-aeca-446f6b6fe3eb None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:21.472317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-16ec80c7-91d0-4912-aeca-446f6b6fe3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:21.554859 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 385/792] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:21 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:21.579607 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffd9cf-3228-4ad2-94ae-04402811f048 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:21.606478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:21.700678 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffd9cf-3228-4ad2-94ae-04402811f048 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:21.735175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445f645-779f-4449-8134-c57936b1905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:21.736005 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445f645-779f-4449-8134-c57936b1905a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:21.736307 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445f645-779f-4449-8134-c57936b1905a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:21.736571 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445f645-779f-4449-8134-c57936b1905a None admin] PATH_INFO: `/v3/services/compute` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:21.737228 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445f645-779f-4449-8134-c57936b1905a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:21.738615 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445f645-779f-4449-8134-c57936b1905a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-d445f645-779f-4449-8134-c57936b1905a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:21.750936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:21.751967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 408/793] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:21.759641 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec80c7-91d0-4912-aeca-446f6b6fe3eb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:21.866978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec80c7-91d0-4912-aeca-446f6b6fe3eb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:21.901279 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:21.907882 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490713c-aa05-4dcb-ab08-a6d529598e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:21.908561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490713c-aa05-4dcb-ab08-a6d529598e1b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:21.908846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490713c-aa05-4dcb-ab08-a6d529598e1b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:21.909150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490713c-aa05-4dcb-ab08-a6d529598e1b None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:21.909834 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490713c-aa05-4dcb-ab08-a6d529598e1b None admin] RBAC: Adding query filter params (name=compute) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:21.910150 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490713c-aa05-4dcb-ab08-a6d529598e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:21.911610 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f490713c-aa05-4dcb-ab08-a6d529598e1b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:21.916899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 386/794] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:21.922750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445f645-779f-4449-8134-c57936b1905a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:22.021317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:22.046649 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445f645-779f-4449-8134-c57936b1905a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:22.089000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d2621-4654-40c1-ae73-a46c250adba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:22.089772 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d2621-4654-40c1-ae73-a46c250adba1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:22.090147 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d2621-4654-40c1-ae73-a46c250adba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:22.090422 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d2621-4654-40c1-ae73-a46c250adba1 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:22.091126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d2621-4654-40c1-ae73-a46c250adba1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:22.091463 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d2621-4654-40c1-ae73-a46c250adba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:22.092872 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d2621-4654-40c1-ae73-a46c250adba1 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:22.097428 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 409/795] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:23.217604 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f387-2d18-4a16-8e0b-059731fb07d5 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:23.218387 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f387-2d18-4a16-8e0b-059731fb07d5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:23.218536 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215f387-2d18-4a16-8e0b-059731fb07d5 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:23.221007 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 387/796] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:23.226702 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce92f-7476-4627-9b30-b3208aa041b3 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:23.227440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce92f-7476-4627-9b30-b3208aa041b3 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:23.227440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ce92f-7476-4627-9b30-b3208aa041b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:23.246153 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-b93ce92f-7476-4627-9b30-b3208aa041b3 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:23.247406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-b93ce92f-7476-4627-9b30-b3208aa041b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:23.356636 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 410/797] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:23.388436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f387-2d18-4a16-8e0b-059731fb07d5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:23.498490 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215f387-2d18-4a16-8e0b-059731fb07d5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:23.534099 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:23.534765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:23.535046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:23.535356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:23.536076 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:23.537600 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:23.539006 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING keystone.server.flask.common [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 10:12:23.557072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.sql.core [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 10:12:23.557072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 10:12:23.557072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [parameters: {'id': 'b605c4e1e7a54384a193acd35ec9d30e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 10:12:23.557072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87019) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b605c4e1e7a54384a193acd35ec9d30e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b605c4e1e7a54384a193acd35ec9d30e. May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result = self._query(query) May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application conn.query(q) May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 10:12:23.579725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result.read() May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 10:12:23.580590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application next(self.gen) May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application yield resource May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application next(self.gen) May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.session.rollback() May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.force_reraise() May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise self.value May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application session.commit() May 25 10:12:23.581605 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._prepare_impl() May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.session.flush() May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._flush(objects) May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application compat.raise_( May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application flush_context.execute() May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 10:12:23.582537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rec.execute(self) May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 10:12:23.583537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result = self._query(query) May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application conn.query(q) May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result.read() May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 10:12:23.584443 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [parameters: {'id': 'b605c4e1e7a54384a193acd35ec9d30e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:23.585321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:23.586102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b605c4e1e7a54384a193acd35ec9d30e. May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:23.589841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 388/798] 10.222.0.67 () {60 vars in 1140 bytes} [Wed May 25 10:12:23 2022] POST /identity/v3/projects => generated 262 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:23.590696 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ce92f-7476-4627-9b30-b3208aa041b3 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:23.675048 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:23.708603 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ce92f-7476-4627-9b30-b3208aa041b3 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:23.743828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63414eb0-8a4b-471d-99a9-2fb2f52147b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:23.744684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414eb0-8a4b-471d-99a9-2fb2f52147b4 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:23.744968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414eb0-8a4b-471d-99a9-2fb2f52147b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:23.745240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63414eb0-8a4b-471d-99a9-2fb2f52147b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:23.766625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63414eb0-8a4b-471d-99a9-2fb2f52147b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:23.769434 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63414eb0-8a4b-471d-99a9-2fb2f52147b4 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-63414eb0-8a4b-471d-99a9-2fb2f52147b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:12:23.792297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:23.793232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:12:23.794122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:23.794900 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 411/799] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:23.804291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:23.882473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:23.944826 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6151-62c4-4753-8f9b-08b700971c83 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:23.987783 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf10849-5b82-4859-963f-f38955ad5fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:23.988677 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf10849-5b82-4859-963f-f38955ad5fcc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:23.989082 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf10849-5b82-4859-963f-f38955ad5fcc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:23.989447 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf10849-5b82-4859-963f-f38955ad5fcc None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:23.990526 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf10849-5b82-4859-963f-f38955ad5fcc None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:23.990978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf10849-5b82-4859-963f-f38955ad5fcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:23.993328 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf10849-5b82-4859-963f-f38955ad5fcc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:24.025935 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 389/800] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:24.608528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c353-4d1f-453c-ba05-ae01d3b8aa99 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:24.609109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c353-4d1f-453c-ba05-ae01d3b8aa99 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:24.609109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c353-4d1f-453c-ba05-ae01d3b8aa99 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:24.610456 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 412/801] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:24.620091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d22fb-a1a5-4cc5-a31c-2e50fcdd78fd None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:24.620538 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d22fb-a1a5-4cc5-a31c-2e50fcdd78fd None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:24.620662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d22fb-a1a5-4cc5-a31c-2e50fcdd78fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:24.646551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-d12d22fb-a1a5-4cc5-a31c-2e50fcdd78fd None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:24.649058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-d12d22fb-a1a5-4cc5-a31c-2e50fcdd78fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:24.741345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 390/802] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:24 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:24.767844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6c353-4d1f-453c-ba05-ae01d3b8aa99 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:24.892451 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6c353-4d1f-453c-ba05-ae01d3b8aa99 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:24.926994 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:24.932809 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf38b52-9f76-45ce-808e-ad7f8d6dacf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:24.933485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38b52-9f76-45ce-808e-ad7f8d6dacf0 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:24.933767 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38b52-9f76-45ce-808e-ad7f8d6dacf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:24.934044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38b52-9f76-45ce-808e-ad7f8d6dacf0 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:24.934768 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf38b52-9f76-45ce-808e-ad7f8d6dacf0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:24.936193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf38b52-9f76-45ce-808e-ad7f8d6dacf0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:24.954421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 413/803] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:12:24 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:26.666452 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987baae-b55f-4611-8f44-14b4b2706244 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:26.667134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987baae-b55f-4611-8f44-14b4b2706244 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:26.667134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987baae-b55f-4611-8f44-14b4b2706244 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:26.668465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 391/804] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:26.673756 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8f72f-7205-47f4-99b1-cf9a6c2b489e None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:26.674188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8f72f-7205-47f4-99b1-cf9a6c2b489e None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:26.674272 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8f72f-7205-47f4-99b1-cf9a6c2b489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:26.691984 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-7da8f72f-7205-47f4-99b1-cf9a6c2b489e None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:26.693149 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-7da8f72f-7205-47f4-99b1-cf9a6c2b489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:26.766586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 414/805] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:26 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:26.793372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987baae-b55f-4611-8f44-14b4b2706244 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:26.847033 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:26.907833 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987baae-b55f-4611-8f44-14b4b2706244 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:26.943964 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:26.944644 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:26.944932 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:26.945221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:26.945959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:26.947577 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:26.964172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.sql.core [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 10:12:26.964172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 10:12:26.964172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [parameters: {'user_id': '1d9913a9f90b436ab7b640ab0eb08744', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 10:12:26.964172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87019) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result = self._query(query) May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application conn.query(q) May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result.read() May 25 10:12:26.971498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 10:12:26.972556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application next(self.gen) May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application yield resource May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application next(self.gen) May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.session.rollback() May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.force_reraise() May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise self.value May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application session.commit() May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 10:12:26.973531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._prepare_impl() May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.session.flush() May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._flush(objects) May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application compat.raise_( May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application flush_context.execute() May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rec.execute(self) May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 10:12:26.974440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 10:12:26.975369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result = self._query(query) May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application conn.query(q) May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application result.read() May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 10:12:26.976222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [parameters: {'user_id': '1d9913a9f90b436ab7b640ab0eb08744', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:26.977047 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 10:12:26.977847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 10:12:26.978854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 10:12:26.978854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 10:12:26.978854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 10:12:26.978854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 10:12:26.978854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 10:12:26.978854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:26.978854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 392/806] 10.222.0.67 () {60 vars in 1131 bytes} [Wed May 25 10:12:26 2022] POST /identity/v3/users => generated 160 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:26.980987 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8f72f-7205-47f4-99b1-cf9a6c2b489e None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:27.083127 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8f72f-7205-47f4-99b1-cf9a6c2b489e None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:27.101010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:27.118859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa1a06-cabe-42d3-860c-5ae20326b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:27.119717 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa1a06-cabe-42d3-860c-5ae20326b621 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:27.120173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa1a06-cabe-42d3-860c-5ae20326b621 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:27.120452 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa1a06-cabe-42d3-860c-5ae20326b621 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:27.127555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa1a06-cabe-42d3-860c-5ae20326b621 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:27.129010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa1a06-cabe-42d3-860c-5ae20326b621 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-0baa1a06-cabe-42d3-860c-5ae20326b621 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:12:27.144349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:27.145305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:27.146264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 415/807] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:12:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:27.151863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:27.259596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b8da3-a469-4763-b414-66c737c3cfb6 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:27.262702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:27.300984 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372b10-ee66-4ff5-9962-b0f7b191a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:27.301674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372b10-ee66-4ff5-9962-b0f7b191a527 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:27.301953 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372b10-ee66-4ff5-9962-b0f7b191a527 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:27.302224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372b10-ee66-4ff5-9962-b0f7b191a527 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:27.303030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372b10-ee66-4ff5-9962-b0f7b191a527 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:27.303372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372b10-ee66-4ff5-9962-b0f7b191a527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:27.305041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372b10-ee66-4ff5-9962-b0f7b191a527 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:27.344026 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 393/808] 10.222.0.67 () {56 vars in 1101 bytes} [Wed May 25 10:12:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:27.476907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404f8e-f5d1-4876-b8cc-de6ffead804d None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:27.477140 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404f8e-f5d1-4876-b8cc-de6ffead804d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:27.477416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404f8e-f5d1-4876-b8cc-de6ffead804d None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:27.478837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 416/809] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:27.485086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7515-00ef-4017-a881-f44ff7c7bcb5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:27.485333 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7515-00ef-4017-a881-f44ff7c7bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:27.485637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d7515-00ef-4017-a881-f44ff7c7bcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:27.505514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-366d7515-00ef-4017-a881-f44ff7c7bcb5 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:27.507077 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-366d7515-00ef-4017-a881-f44ff7c7bcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:27.589186 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 394/810] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:27 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:27.612974 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404f8e-f5d1-4876-b8cc-de6ffead804d None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:27.721210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404f8e-f5d1-4876-b8cc-de6ffead804d None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:27.755823 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:27.756664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:27.756945 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:27.757225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:27.757866 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:27.759312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:27.771117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:27.772242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:12:27.773082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 417/811] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:27.780179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7515-00ef-4017-a881-f44ff7c7bcb5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:27.877456 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:27.888058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d7515-00ef-4017-a881-f44ff7c7bcb5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:27.924306 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:27.925046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:27.925356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:27.925639 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:27.926447 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:27.926891 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:27.928481 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:27.933879 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 395/812] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:27.940262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:27.991672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:28.056114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a38c8-e515-49e7-a904-0c44a134fca3 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:28.093477 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:28.094142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:28.094425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:28.094698 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:28.095446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:28.095753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:28.097144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:28.101942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 418/813] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:28.108816 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:28.211673 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d43f7-9a05-4c9f-8aaf-0370b9c46850 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:28.250828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec41cc-b27b-48ee-9011-b2791fcb1485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:28.251531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec41cc-b27b-48ee-9011-b2791fcb1485 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:28.251820 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec41cc-b27b-48ee-9011-b2791fcb1485 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:28.252095 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec41cc-b27b-48ee-9011-b2791fcb1485 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:28.252894 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec41cc-b27b-48ee-9011-b2791fcb1485 None admin] RBAC: Adding query filter params (interface=public, service_id=2dcf7fab08f740bea14ed191d03f0192, region_id=RegionOne) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:28.253205 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec41cc-b27b-48ee-9011-b2791fcb1485 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:28.254609 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec41cc-b27b-48ee-9011-b2791fcb1485 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:28.260138 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 396/814] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 10:12:28 2022] GET /identity/v3/endpoints?service_id=2dcf7fab08f740bea14ed191d03f0192&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:28.266003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:28.375434 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b126681-74d7-4e88-ab82-9ee63bf0fa06 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:28.382296 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:28.410866 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5423f28-8234-4f51-9ff4-e3b728b7f4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:28.411560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423f28-8234-4f51-9ff4-e3b728b7f4ae None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:28.411838 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423f28-8234-4f51-9ff4-e3b728b7f4ae None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:28.412109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5423f28-8234-4f51-9ff4-e3b728b7f4ae None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:28.412790 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5423f28-8234-4f51-9ff4-e3b728b7f4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:28.414171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5423f28-8234-4f51-9ff4-e3b728b7f4ae None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:28.420649 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 419/815] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 10:12:28 2022] GET /identity/v3/services => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:12:31.042377 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620aee-a7b8-4497-b485-3a4c1bb5ddda None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:31.043094 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620aee-a7b8-4497-b485-3a4c1bb5ddda None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:31.043094 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23620aee-a7b8-4497-b485-3a4c1bb5ddda None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:31.045040 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 397/816] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:12:31.050494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69bb5c-83c2-4339-b03e-d1fe0a870e54 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:31.050917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69bb5c-83c2-4339-b03e-d1fe0a870e54 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:31.051029 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69bb5c-83c2-4339-b03e-d1fe0a870e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:31.081402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-9e69bb5c-83c2-4339-b03e-d1fe0a870e54 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:12:31.083135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-9e69bb5c-83c2-4339-b03e-d1fe0a870e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:12:31.158244 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 420/817] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:12:31 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:12:31.183523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620aee-a7b8-4497-b485-3a4c1bb5ddda None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:31.204778 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:31.325518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23620aee-a7b8-4497-b485-3a4c1bb5ddda None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:31.384394 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:31.385383 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:31.385915 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:31.386335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:31.387094 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:31.388541 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:12:31.400884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:12:31.402147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:12:31.403557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 398/818] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:12:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:12:31.413461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69bb5c-83c2-4339-b03e-d1fe0a870e54 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:31.528002 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:31.531398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69bb5c-83c2-4339-b03e-d1fe0a870e54 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:31.569573 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:31.570249 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:31.570560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:31.570842 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:31.571587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:31.571898 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:31.573487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:31.578736 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 421/819] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:31.585012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:31.675733 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:31.699197 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da47c9c-6eba-4794-b8a6-a0301616a1b1 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:31.735765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f517b-be2e-414b-9da3-b3134798f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:31.736441 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f517b-be2e-414b-9da3-b3134798f742 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:31.736730 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f517b-be2e-414b-9da3-b3134798f742 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:31.737013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f517b-be2e-414b-9da3-b3134798f742 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:31.737735 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f517b-be2e-414b-9da3-b3134798f742 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:12:31.738046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f517b-be2e-414b-9da3-b3134798f742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:31.739533 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f517b-be2e-414b-9da3-b3134798f742 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:31.744524 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 399/820] 10.222.0.67 () {56 vars in 1112 bytes} [Wed May 25 10:12:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:12:31.751302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:12:31.878241 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8420d-c272-496f-9adb-891de89047e7 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:12:31.918112 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ded7-d094-4f33-b86b-3ae6ab07a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:12:31.918782 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ded7-d094-4f33-b86b-3ae6ab07a724 None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:12:31.919063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ded7-d094-4f33-b86b-3ae6ab07a724 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:12:31.919363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ded7-d094-4f33-b86b-3ae6ab07a724 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:12:31.920123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ded7-d094-4f33-b86b-3ae6ab07a724 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:12:31.921506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ded7-d094-4f33-b86b-3ae6ab07a724 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:12:31.944682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 422/821] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 10:12:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:12:41.742766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=27 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:12:41.936953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:35.183063 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68252d-72f5-460c-8687-a2e194f6deab None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:35.183661 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68252d-72f5-460c-8687-a2e194f6deab None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:35.183757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68252d-72f5-460c-8687-a2e194f6deab None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:35.185575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 400/822] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:13:35.192630 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0c19c-b360-44ad-8cee-def0c4dadf2a None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:35.193084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0c19c-b360-44ad-8cee-def0c4dadf2a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:35.193300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0c19c-b360-44ad-8cee-def0c4dadf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:35.211795 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-57f0c19c-b360-44ad-8cee-def0c4dadf2a None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:13:35.213114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-57f0c19c-b360-44ad-8cee-def0c4dadf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:13:35.307321 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 423/823] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:13:35 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:13:35.338943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68252d-72f5-460c-8687-a2e194f6deab None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:35.464959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68252d-72f5-460c-8687-a2e194f6deab None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:35.503692 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:35.504628 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:35.504938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:35.505193 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:35.519476 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:35.521274 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:35.542078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:35.543201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:35.544402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:35.544402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:35.544402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:35.544402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:35.544402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 401/824] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:35.550641 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0c19c-b360-44ad-8cee-def0c4dadf2a None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:35.675981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0c19c-b360-44ad-8cee-def0c4dadf2a None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:35.706750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:35.718462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b811fe-8c25-4455-bc35-13532db4c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:35.719180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b811fe-8c25-4455-bc35-13532db4c454 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:35.719498 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b811fe-8c25-4455-bc35-13532db4c454 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:35.719922 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b811fe-8c25-4455-bc35-13532db4c454 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:35.720658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b811fe-8c25-4455-bc35-13532db4c454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:35.721112 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b811fe-8c25-4455-bc35-13532db4c454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:35.722503 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b811fe-8c25-4455-bc35-13532db4c454 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:35.740666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 424/825] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:35.741815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:35.810748 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:35.875075 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eff64-f15e-48ac-b6dd-23b224569d9a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:35.914273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133c42b-f17f-4a70-9afe-af8db94a4451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:35.915046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c42b-f17f-4a70-9afe-af8db94a4451 None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:35.915415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c42b-f17f-4a70-9afe-af8db94a4451 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:35.915750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133c42b-f17f-4a70-9afe-af8db94a4451 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:35.916515 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133c42b-f17f-4a70-9afe-af8db94a4451 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:35.918198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133c42b-f17f-4a70-9afe-af8db94a4451 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:35.943113 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 402/826] 10.222.0.67 () {60 vars in 1132 bytes} [Wed May 25 10:13:35 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:13:38.715104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1a48-3d24-4454-a78d-7df4c7e6f1b1 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:38.715725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1a48-3d24-4454-a78d-7df4c7e6f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:38.715725 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb1a48-3d24-4454-a78d-7df4c7e6f1b1 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:38.717287 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 425/827] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:13:38.723259 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6dd0-3cac-4402-a979-de0866424085 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:38.723724 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6dd0-3cac-4402-a979-de0866424085 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:38.723926 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6dd0-3cac-4402-a979-de0866424085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:38.744154 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-deef6dd0-3cac-4402-a979-de0866424085 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:13:38.745826 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-deef6dd0-3cac-4402-a979-de0866424085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:13:38.823501 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 403/828] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:13:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:13:38.853800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb1a48-3d24-4454-a78d-7df4c7e6f1b1 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:38.982041 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb1a48-3d24-4454-a78d-7df4c7e6f1b1 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:39.024183 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:39.025000 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:39.025282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:39.025554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:39.037955 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:13:39.046673 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:39.048599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:39.050201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 426/829] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:13:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:39.054559 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6dd0-3cac-4402-a979-de0866424085 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:39.100874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:39.171604 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6dd0-3cac-4402-a979-de0866424085 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:39.215573 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:39.216772 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:39.217173 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:39.217451 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:39.218221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:39.218534 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:39.219971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:39.231907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 404/830] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:39.239317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:39.291634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:39.365394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dd477-2b66-4b04-83f1-c334cd7ca0f1 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:39.400391 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:39.401195 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:39.401479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:39.401753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:39.412098 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:39.413593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:39.431657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:39.432965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:39.434224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:39.434224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:39.434224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:39.434224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:39.434224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 427/831] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:39.439581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:39.557004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:39.560708 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796586bf-c708-4728-b4dd-ca909621b8c9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:39.598944 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:39.599661 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:39.599951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:39.600275 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:39.600994 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:39.601309 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:39.602662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:39.618012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 405/832] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:39.624299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:39.738306 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:39.743084 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f5783-9c77-455a-881c-64ed5e117fda None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:39.782506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:39.783363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:39.783650 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:39.783927 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:39.792462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:39.794230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:13:39.810363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:39.811676 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:39.813182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 428/833] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:39.817565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:39.929627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffcfe-bae1-44e6-be91-306d7350f9dc None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:39.970366 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:39.971176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:39.971503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:39.971844 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:39.972798 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:39.973060 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:39.974636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:39.995163 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 406/834] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 10:13:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:40.001564 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:40.118145 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413ae6-6841-4eb5-88f4-64a5b87b7265 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:40.157980 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:40.158643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:40.158926 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:40.159202 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:40.191943 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:40.242499 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:40.244667 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:40.362215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 429/835] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:13:40 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 10:13:40.368340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:40.390983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:40.478647 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d184280-679d-4b43-8177-786e8c839aa8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:40.520788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:40.521648 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:40.521938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:40.522351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:40.534857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:40.536548 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:40.557430 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:40.559586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:40.560929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:40.560929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:40.560929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:40.560929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:40.560929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 407/836] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:40.565228 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:40.627921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:40.677322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb63d6-45eb-4c4f-8c01-29cb7cc33208 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:40.712590 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:40.713311 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:40.713514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:40.713806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:40.714632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:40.714982 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:40.716601 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:40.728484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 430/837] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:40.734395 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:40.816832 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:40.849058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9f9dd-2049-4ae9-9ba7-954773d748ba None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:40.885442 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:40.886166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:40.886454 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:40.886737 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:40.895950 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:40.897429 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:13:40.915941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:40.917146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:40.922986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 408/838] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:13:40.923530 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:41.037531 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4e250-5617-4e5f-906e-78ab0579844e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:41.057402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:41.078106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2790-1878-4ea1-be67-b03ae69bbf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:41.078783 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2790-1878-4ea1-be67-b03ae69bbf1f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:41.079068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2790-1878-4ea1-be67-b03ae69bbf1f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:41.079372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2790-1878-4ea1-be67-b03ae69bbf1f None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:41.080170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2790-1878-4ea1-be67-b03ae69bbf1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:41.080483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2790-1878-4ea1-be67-b03ae69bbf1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:41.081937 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2790-1878-4ea1-be67-b03ae69bbf1f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:41.096329 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 431/839] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:13:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:41.103191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:41.213810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b278f79-60cf-4ce5-9ece-b57e6bb9a0b2 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:41.246358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:41.251725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8bd18-dff1-47c2-9775-1d5ff0da1b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:41.252612 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bd18-dff1-47c2-9775-1d5ff0da1b9a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:41.253090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bd18-dff1-47c2-9775-1d5ff0da1b9a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:41.253372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bd18-dff1-47c2-9775-1d5ff0da1b9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:41.254314 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8bd18-dff1-47c2-9775-1d5ff0da1b9a None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=1c4c0e33447e4a70be3de0256513ef51) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:41.254704 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8bd18-dff1-47c2-9775-1d5ff0da1b9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:41.256353 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8bd18-dff1-47c2-9775-1d5ff0da1b9a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:41.262599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 409/840] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:13:41 2022] GET /identity/v3/role_assignments?user.id=1c4c0e33447e4a70be3de0256513ef51&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:43.864759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7eca7-9e50-4b79-a424-d09638925c40 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:43.865350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7eca7-9e50-4b79-a424-d09638925c40 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:43.865350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7eca7-9e50-4b79-a424-d09638925c40 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:43.866665 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 432/841] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:13:43.872025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698762b-07ae-464e-810e-e3cd2fade938 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:43.872993 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698762b-07ae-464e-810e-e3cd2fade938 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:43.872993 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698762b-07ae-464e-810e-e3cd2fade938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:43.892569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b698762b-07ae-464e-810e-e3cd2fade938 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:13:43.893785 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b698762b-07ae-464e-810e-e3cd2fade938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:13:43.961516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 410/842] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:13:43 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:13:43.985699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7eca7-9e50-4b79-a424-d09638925c40 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:44.098291 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7eca7-9e50-4b79-a424-d09638925c40 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:44.133912 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:44.134718 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:44.134998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:44.135281 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:44.145843 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:13:44.153643 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:44.154631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:44.155545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 433/843] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:13:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:13:44.160929 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698762b-07ae-464e-810e-e3cd2fade938 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:44.265892 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698762b-07ae-464e-810e-e3cd2fade938 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:44.291221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:44.302419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:44.303106 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:44.303438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:44.303721 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:44.304480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:44.304794 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:44.306223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:44.315204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 411/844] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:13:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:44.323010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:44.367752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:44.433936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31e90a-4205-44a8-b050-a77c26e202c6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:44.471341 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:44.472216 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:44.472508 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:44.472806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:44.484500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:44.485978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:44.507520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:44.508975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:44.510166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:44.510166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:44.510166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:44.510166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:44.510166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 434/845] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:13:44.515348 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:44.631355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef956725-18cc-4795-981b-c076724f4ee3 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:44.669632 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:44.670395 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:44.670689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:44.671027 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:44.671810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:44.672127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:44.673689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:44.687878 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 412/846] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:44.693775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:44.798538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:44.809109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24d9b8-079c-42d7-a5ff-cc32a89b24c6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:44.847755 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:44.848608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:44.848918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:44.849187 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:44.857375 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:44.858959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:13:44.874835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:44.876364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:44.877309 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 435/847] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:44.883075 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:44.939103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:45.000256 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0ad70-f245-4bf9-88f9-85f03fde18dd None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:45.042870 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:45.043690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:45.044120 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:45.044657 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:45.046026 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:45.046495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:45.048237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:45.068589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 413/848] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 10:13:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:45.075108 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:45.198023 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59038dd9-b9cf-4fd1-ab2a-dfebacbc6586 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:45.238287 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:45.239093 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:45.239409 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:45.239684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:45.252537 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:45.253998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:45.274942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:45.276114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:45.277210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:45.277210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:45.277210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:45.277210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:45.279507 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 436/849] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:45.283151 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:45.393155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3faa55-d9ea-4a99-a419-4f3b5e426d8a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:45.395513 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:45.429786 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:45.430451 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:45.430737 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:45.431015 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:45.431822 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:45.432136 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:45.433576 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:45.446075 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 414/850] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:45.452430 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:45.455480 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:45.576771 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6593fb-df41-45f8-9626-e84cda2d8d89 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:45.612282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:45.613090 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:45.613372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:45.613646 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:45.620933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:45.623267 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:13:45.639207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:45.640282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:45.641431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 437/851] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:45.646766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:45.767943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4087b-6b4b-47c4-b14f-ae704bfdafde None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:45.809010 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89941300-5db8-41f2-9aa3-1549795df405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:45.809885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89941300-5db8-41f2-9aa3-1549795df405 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:45.810173 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89941300-5db8-41f2-9aa3-1549795df405 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:45.810590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89941300-5db8-41f2-9aa3-1549795df405 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:45.811556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89941300-5db8-41f2-9aa3-1549795df405 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:45.811998 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89941300-5db8-41f2-9aa3-1549795df405 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:45.813788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89941300-5db8-41f2-9aa3-1549795df405 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:45.827411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 415/852] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:13:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:45.833570 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:45.901580 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:45.945420 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52492d93-1364-4e43-9828-3b1715196dd6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:45.980234 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21195bc0-d159-48b9-a81e-8287d031d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:45.981135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195bc0-d159-48b9-a81e-8287d031d101 None admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:45.981516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195bc0-d159-48b9-a81e-8287d031d101 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:45.981796 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21195bc0-d159-48b9-a81e-8287d031d101 None admin] PATH_INFO: `/v3/projects/061cceafef044884ad92a96749c79856/users/1c4c0e33447e4a70be3de0256513ef51/roles/830cfcbd6b7e49b7859e504127139f9f` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:45.998711 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195bc0-d159-48b9-a81e-8287d031d101 None admin] RBAC: Authorizing `identity:create_grant(project_id=061cceafef044884ad92a96749c79856, user_id=1c4c0e33447e4a70be3de0256513ef51, role_id=830cfcbd6b7e49b7859e504127139f9f)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:46.000201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21195bc0-d159-48b9-a81e-8287d031d101 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:46.014079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 438/853] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:13:45 2022] PUT /identity/v3/projects/061cceafef044884ad92a96749c79856/users/1c4c0e33447e4a70be3de0256513ef51/roles/830cfcbd6b7e49b7859e504127139f9f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:13:48.269546 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8cfcb-f7b6-4f3d-a064-701969fedea1 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:48.270145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8cfcb-f7b6-4f3d-a064-701969fedea1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:48.270145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8cfcb-f7b6-4f3d-a064-701969fedea1 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:48.271589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 416/854] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:13:48.277257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce08eb-f987-4f97-a756-1f106d25e5ac None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:48.277712 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce08eb-f987-4f97-a756-1f106d25e5ac None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:48.277858 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce08eb-f987-4f97-a756-1f106d25e5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:48.296262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-c1ce08eb-f987-4f97-a756-1f106d25e5ac None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:13:48.297647 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-c1ce08eb-f987-4f97-a756-1f106d25e5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:13:48.367619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 439/855] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:13:48 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:13:48.394207 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8cfcb-f7b6-4f3d-a064-701969fedea1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:48.421116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:48.503634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8cfcb-f7b6-4f3d-a064-701969fedea1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:48.551406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:48.552148 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:48.552474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:48.552700 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:48.564846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:13:48.572625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:48.573664 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:48.574588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 417/856] 10.222.0.67 () {56 vars in 1102 bytes} [Wed May 25 10:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:48.580427 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce08eb-f987-4f97-a756-1f106d25e5ac None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:48.626707 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:48.689506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce08eb-f987-4f97-a756-1f106d25e5ac None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:48.726212 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:48.726987 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:48.727306 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:48.727608 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:48.728346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:48.728648 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:48.730105 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:48.740705 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 440/857] 10.222.0.67 () {56 vars in 1103 bytes} [Wed May 25 10:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:13:48.746637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:48.841251 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:48.858824 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b905f-5f67-425a-b67f-b28997e9196a None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:48.892853 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:48.893667 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:48.893943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:48.894210 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:48.905250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:48.906722 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:48.923652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:48.924599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:48.925745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:48.925745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:48.925745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:48.925745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:48.925745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 418/858] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:48.930871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:49.045432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cd8b9-de77-4aa6-8cfb-6d5715850a2f None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:49.048161 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:49.086035 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:49.086659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:49.086918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:49.087211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:49.087968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:49.088292 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:49.089709 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:49.102621 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 441/859] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:49.108542 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:49.224176 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47068d-e4b0-443d-998c-73229c7da694 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:49.263048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:49.263921 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:49.264199 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:49.264516 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:49.267470 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:49.272981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:49.274662 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:13:49.289802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:49.290866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:49.291899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 419/860] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:49.297182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:49.417875 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da903dea-ef1c-49c6-9862-c79f29d2131e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:49.461181 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:49.462116 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:49.462455 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:49.462805 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:49.463932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:49.464317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:49.466789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:49.489114 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 442/861] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 10:13:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:49.494923 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:49.614449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49852ee9-4966-4790-9b65-65c2cdc43179 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:49.649655 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:49.650326 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:49.650690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:49.650975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:49.717684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:49.724966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:49.726672 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:49.850494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 420/862] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:13:49 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 10:13:49.851980 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:49.879206 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:49.960871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144a2c2-24cd-4e26-90c7-425e2108f9f4 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:50.001005 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:50.001813 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:50.002075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:50.002346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:50.013665 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:50.015147 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:50.035383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:50.036407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:50.037291 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:50.037291 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:50.037291 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:50.037291 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:50.037291 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 443/863] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:50.043000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:50.147646 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:50.154017 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1924fce-8c86-4a69-bbfa-8905bb8bc0b0 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:50.193009 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:50.193689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:50.193980 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:50.194256 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:50.194987 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:50.195350 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:50.196729 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:50.208984 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 421/864] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:50.214791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:50.299157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:50.330789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38113b-c3fa-437a-8d40-eb29a722af9e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:50.370535 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:50.371523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:50.371824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:50.372244 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:50.380483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:50.382115 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:13:50.396738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:50.397886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:50.398895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 444/865] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:50.404694 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:50.519608 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c2573-1a89-437e-8610-3eb10b9a3e68 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:50.571331 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f58c19-811f-4758-a0f8-0b394355d956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:50.571894 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58c19-811f-4758-a0f8-0b394355d956 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:50.572204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58c19-811f-4758-a0f8-0b394355d956 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:50.572473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58c19-811f-4758-a0f8-0b394355d956 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:50.573224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f58c19-811f-4758-a0f8-0b394355d956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:50.573568 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f58c19-811f-4758-a0f8-0b394355d956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:50.575361 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f58c19-811f-4758-a0f8-0b394355d956 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:50.587904 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 422/866] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:50.594347 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:50.708666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f757-fcfc-4fd9-b73a-b3e94b92104d None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:50.745896 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80507e02-ba02-44d0-b8ba-27805fd383fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:50.746576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80507e02-ba02-44d0-b8ba-27805fd383fa None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:50.746885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80507e02-ba02-44d0-b8ba-27805fd383fa None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:50.747172 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80507e02-ba02-44d0-b8ba-27805fd383fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:50.748049 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80507e02-ba02-44d0-b8ba-27805fd383fa None admin] RBAC: Adding query filter params (role.id=830cfcbd6b7e49b7859e504127139f9f, scope.project.id=061cceafef044884ad92a96749c79856, user.id=1c4c0e33447e4a70be3de0256513ef51) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:50.748366 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80507e02-ba02-44d0-b8ba-27805fd383fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:50.749886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80507e02-ba02-44d0-b8ba-27805fd383fa None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:50.751958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:50.757575 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 445/867] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:13:50 2022] GET /identity/v3/role_assignments?user.id=1c4c0e33447e4a70be3de0256513ef51&scope.project.id=061cceafef044884ad92a96749c79856&role.id=830cfcbd6b7e49b7859e504127139f9f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:53.207885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596ae7c-5e1d-4de8-8e2e-4e5de0b31a37 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:53.208508 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596ae7c-5e1d-4de8-8e2e-4e5de0b31a37 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:53.208508 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596ae7c-5e1d-4de8-8e2e-4e5de0b31a37 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:53.210041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 423/868] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:13:53.215622 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182e72-5e2d-47fc-a92c-f7fbc4cbe464 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:53.216096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182e72-5e2d-47fc-a92c-f7fbc4cbe464 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:53.216329 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25182e72-5e2d-47fc-a92c-f7fbc4cbe464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:53.240318 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-25182e72-5e2d-47fc-a92c-f7fbc4cbe464 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:13:53.241766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-25182e72-5e2d-47fc-a92c-f7fbc4cbe464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:13:53.327704 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 446/869] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:13:53 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:13:53.359828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596ae7c-5e1d-4de8-8e2e-4e5de0b31a37 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:53.379419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:53.475883 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596ae7c-5e1d-4de8-8e2e-4e5de0b31a37 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:53.516085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:53.516961 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:53.517308 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:53.517567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:53.530372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:13:53.538781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:53.540011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:53.541051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 424/870] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:53.546986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182e72-5e2d-47fc-a92c-f7fbc4cbe464 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:53.666838 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25182e72-5e2d-47fc-a92c-f7fbc4cbe464 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:53.700647 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:53.711898 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:53.712590 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:53.712877 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:53.713158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:53.714148 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:53.714621 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:53.716285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:53.726599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 447/871] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:53.733269 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:53.829767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:53.856706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eff27-36f2-4e45-a2d5-720d69074f2c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:53.898398 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:53.899245 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:53.899565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:53.899845 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:53.910974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:53.912589 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:53.930320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:53.931502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:53.932636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:53.932636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:53.932636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:53.932636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:53.932636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 425/872] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:53.939722 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:54.058359 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7df69d-5fea-49fa-9e92-eb716d7a89cc None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:54.098070 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:54.098752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:54.099034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:54.099338 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:54.100092 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:54.100400 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:54.101787 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:54.114217 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 448/873] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:54.120072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:54.247036 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043f85e-5a5d-4acd-b82c-941b17fd94e5 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:54.275930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:54.287700 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:54.288585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:54.288868 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:54.289160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] PATH_INFO: `/v3/users/placement` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:54.297201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:54.298702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:13:54.313974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:54.316051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:54.318174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 426/874] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:13:54.323893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:54.394794 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:54.459263 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5c8b0-031b-4f5b-9424-50b8e4824aff None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:54.497423 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:54.497638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:54.497926 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:54.498221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:54.499076 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:54.499463 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:54.501056 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:54.522706 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 449/875] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 10:13:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:54.528307 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:54.647921 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4059299-91fd-4f7e-94a2-0b5a802e841c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:54.698442 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:54.699592 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:54.700201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:54.700509 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:54.760502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:54.774090 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:54.775631 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:54.885217 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 427/876] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:13:54 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 10:13:54.891433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:54.999559 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4308a-666e-4dc9-88b7-9e13e762a70b None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:55.009517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:55.037703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:55.038517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:55.038796 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:55.039065 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:55.050851 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:55.052396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:55.076726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:55.077972 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:55.079134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:55.079134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:55.079134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:55.079134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:55.083313 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 450/877] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:55.084254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:55.180705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:55.194728 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea6a1b-0d44-47d7-aa07-8b95263e4c6b None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:55.229151 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:55.229830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:55.230116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:55.230466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:55.231348 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:55.231666 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:55.233233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:55.248325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 428/878] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:55.254668 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:55.381471 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f0d90-5def-40fd-a82c-0efedf13a265 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:55.418165 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:55.419205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:55.419547 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:55.419812 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:55.427502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:55.428975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:13:55.443555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:55.444694 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:13:55.445824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 451/879] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 10:13:55.451085 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:55.569469 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b3af3-3239-45c6-817d-cdb1031a3be8 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:55.609863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8321-61e4-40cd-ba12-161f4f2762c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:55.610571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8321-61e4-40cd-ba12-161f4f2762c5 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:55.610845 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8321-61e4-40cd-ba12-161f4f2762c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:55.611125 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8321-61e4-40cd-ba12-161f4f2762c5 None admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:55.612045 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8321-61e4-40cd-ba12-161f4f2762c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:55.612363 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8321-61e4-40cd-ba12-161f4f2762c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:55.613852 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8321-61e4-40cd-ba12-161f4f2762c5 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:55.628371 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 429/880] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:55.635094 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:55.663301 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:55.751674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e211-3c77-480f-9bbb-647c809b78d4 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:55.790162 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7d445-d51e-4bff-8f01-6c8edb74d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:55.790835 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d445-d51e-4bff-8f01-6c8edb74d7ee None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:55.791117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d445-d51e-4bff-8f01-6c8edb74d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:55.791430 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7d445-d51e-4bff-8f01-6c8edb74d7ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:55.792277 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d445-d51e-4bff-8f01-6c8edb74d7ee None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=061cceafef044884ad92a96749c79856, user.id=1c4c0e33447e4a70be3de0256513ef51) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:55.792586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d445-d51e-4bff-8f01-6c8edb74d7ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:55.794286 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7d445-d51e-4bff-8f01-6c8edb74d7ee None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:55.801349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 452/881] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:13:55 2022] GET /identity/v3/role_assignments?user.id=1c4c0e33447e4a70be3de0256513ef51&scope.project.id=061cceafef044884ad92a96749c79856&role.id=079434fe84194c03ae64e10d61e222e6 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:58.074749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751149-7887-4be9-8efe-559e8bcbcaba None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:58.075776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751149-7887-4be9-8efe-559e8bcbcaba None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:58.076001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69751149-7887-4be9-8efe-559e8bcbcaba None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:58.078504 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 430/882] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:13:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:13:58.087501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97647aa-ac33-4692-a0cd-e72c7457442b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:58.087946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97647aa-ac33-4692-a0cd-e72c7457442b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:58.088126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97647aa-ac33-4692-a0cd-e72c7457442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:58.107944 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-a97647aa-ac33-4692-a0cd-e72c7457442b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:13:58.109154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-a97647aa-ac33-4692-a0cd-e72c7457442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:13:58.189182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 453/883] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:13:58 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:13:58.222200 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751149-7887-4be9-8efe-559e8bcbcaba None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:58.235653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:58.342850 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69751149-7887-4be9-8efe-559e8bcbcaba None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:58.392518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:58.393455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:58.394655 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:58.394655 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:58.407738 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:13:58.417110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:58.418223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:58.420034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 431/884] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:58.428460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97647aa-ac33-4692-a0cd-e72c7457442b None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:58.446539 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:58.569014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97647aa-ac33-4692-a0cd-e72c7457442b None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:58.623067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:58.624182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:58.624599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:58.624912 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:58.625911 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:58.626475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:58.628424 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:58.641215 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 454/885] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:58.649053 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:58.729896 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:58.774858 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d740500-1bd2-40ad-9a0a-1e5a2e9b1b44 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:58.814340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:58.815321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:58.815633 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:58.815915 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:58.827409 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:58.828973 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:58.846749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:58.847841 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:58.848847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:58.848847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:58.848847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:58.848847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:58.848847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 432/886] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:58.854416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:58.942009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:58.966954 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3730d-4bb9-403b-b815-c0a80180796e None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:59.003775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:59.004446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:59.004775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:59.004996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:59.005720 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:59.006026 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:59.007432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:59.019776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 455/887] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:59.026181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:59.151913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b14d3-bc9b-440e-9dd5-7fee1cb5f111 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:59.174066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:59.190214 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:59.191034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:59.191317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:59.191631 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] PATH_INFO: `/v3/users/placement` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:59.199504 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:59.201088 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:13:59.215465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:59.216681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:59.218001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 433/888] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:59.222657 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:59.337959 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c6794-820c-41b9-86ab-0becd58302b0 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:59.374482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:59.375129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:59.375474 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:59.375732 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:59.376605 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:59.376921 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:59.378382 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:59.381087 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:59.397157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 456/889] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 10:13:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:59.403432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:59.529995 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96f3c4-0f38-443a-8643-bb96fcd85bce None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:59.567151 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:59.567990 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:59.568277 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:59.568552 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:59.579568 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:59.581031 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:13:59.598313 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:59.599358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:59.600766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:13:59.600766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:13:59.600766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:13:59.600766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:59.600766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 434/890] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:59.605664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:59.713038 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5b7f-70e1-4101-a104-ecbb275dbca3 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:59.752739 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:59.753415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:59.753701 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:59.753974 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:59.754696 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:13:59.755004 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:59.756419 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:59.769200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 457/891] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:13:59.775326 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:13:59.812036 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:13:59.886310 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe53052-6376-44d6-8ab9-f370007817af None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:13:59.921608 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:13:59.922401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:13:59.922683 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:13:59.922958 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:13:59.929871 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:13:59.931439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:13:59.946420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:13:59.947495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:13:59.948401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 435/892] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:13:59.954634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:00.024984 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:00.074478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec5c81-afb4-4f65-93e1-dbf6bfde474a None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:00.110470 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6fe77-ab03-4304-8137-7c44e1371305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:00.111207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6fe77-ab03-4304-8137-7c44e1371305 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:00.111525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6fe77-ab03-4304-8137-7c44e1371305 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:00.111806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6fe77-ab03-4304-8137-7c44e1371305 None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:00.112604 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6fe77-ab03-4304-8137-7c44e1371305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:00.112918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6fe77-ab03-4304-8137-7c44e1371305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:00.114367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6fe77-ab03-4304-8137-7c44e1371305 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:00.126929 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 458/893] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:00.133326 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:00.238001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:00.247322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a45ff-e79f-49bf-882d-38b9a98a32ee None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:00.281927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072555a2-cd0d-425f-9847-3a681612b8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:00.282818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072555a2-cd0d-425f-9847-3a681612b8b3 None admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:00.283106 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072555a2-cd0d-425f-9847-3a681612b8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:00.283406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072555a2-cd0d-425f-9847-3a681612b8b3 None admin] PATH_INFO: `/v3/projects/061cceafef044884ad92a96749c79856/users/1c4c0e33447e4a70be3de0256513ef51/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:00.285419 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072555a2-cd0d-425f-9847-3a681612b8b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=061cceafef044884ad92a96749c79856, user_id=1c4c0e33447e4a70be3de0256513ef51, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:00.286866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072555a2-cd0d-425f-9847-3a681612b8b3 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:00.301173 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 436/894] 10.222.0.67 () {58 vars in 1439 bytes} [Wed May 25 10:14:00 2022] PUT /identity/v3/projects/061cceafef044884ad92a96749c79856/users/1c4c0e33447e4a70be3de0256513ef51/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:14:02.563377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86f2d-cb67-47cd-a5b6-3e1764bab556 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:02.563961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86f2d-cb67-47cd-a5b6-3e1764bab556 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:02.563961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86f2d-cb67-47cd-a5b6-3e1764bab556 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:02.565417 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 459/895] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:14:02.570675 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c72a1b-841e-411f-80bf-ad91ff299331 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:02.571088 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c72a1b-841e-411f-80bf-ad91ff299331 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:02.571250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c72a1b-841e-411f-80bf-ad91ff299331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:02.588784 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-85c72a1b-841e-411f-80bf-ad91ff299331 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:14:02.589986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-85c72a1b-841e-411f-80bf-ad91ff299331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:14:02.662542 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 437/896] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:14:02 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:14:02.691629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a86f2d-cb67-47cd-a5b6-3e1764bab556 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:02.803946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a86f2d-cb67-47cd-a5b6-3e1764bab556 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:02.821455 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:02.844152 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:02.844961 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:02.845246 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:02.845528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:02.856380 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 10:14:02.864031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:02.865075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:02.871027 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 460/897] 10.222.0.67 () {56 vars in 1096 bytes} [Wed May 25 10:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:02.872179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c72a1b-841e-411f-80bf-ad91ff299331 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:02.960771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:02.980764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c72a1b-841e-411f-80bf-ad91ff299331 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:03.015347 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:03.016042 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:03.016335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:03.016613 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:03.017360 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:03.017665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:03.019061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:03.027420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 438/898] 10.222.0.67 () {56 vars in 1099 bytes} [Wed May 25 10:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:03.033514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:03.141007 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a0081-e9fe-42ff-8c85-b9ceb047ad87 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:03.176891 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:03.177682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:03.177968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:03.178249 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:03.190789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:03.192302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:14:03.211516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:03.212519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:03.213789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:14:03.213789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:14:03.213789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:14:03.213789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:03.213789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 461/899] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:03.220054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:03.332535 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278bc0f-1059-4db5-abbb-1c28b39db86c None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:03.369436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:03.370099 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:03.370378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:03.370657 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:03.371415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:03.371729 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:03.373642 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:03.386424 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 439/900] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:03.392738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:03.427016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:03.505022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c1b5-16e9-4977-a58a-d79111ac2adc None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:03.540355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:03.541172 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:03.541454 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:03.541758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:03.550868 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:03.552446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 10:14:03.568156 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:03.569735 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:03.570977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 462/901] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:14:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:03.576456 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:03.580620 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:03.679991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ad04-6d11-45c0-9260-773c4e11470f None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:03.715705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:03.716673 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:03.716953 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:03.717227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:03.718064 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:03.718373 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:03.719842 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:03.736892 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 440/902] 10.222.0.67 () {56 vars in 1143 bytes} [Wed May 25 10:14:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:03.745677 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:03.839913 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:03.856301 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a73220-5133-47cc-80c3-607ca25645a6 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:03.892744 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:03.893396 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:03.893680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:03.893953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:03.963313 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:03.964814 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:04.052175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:04.068962 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 463/903] 10.222.0.67 () {58 vars in 1282 bytes} [Wed May 25 10:14:03 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 10:14:04.075669 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:04.140847 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:04.184132 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced78cb-ab80-4977-99fd-6fd5b51a2abb None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:04.219970 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:04.220705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:04.220992 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:04.221271 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:04.232147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:04.233626 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 10:14:04.251110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:04.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:04.253172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 10:14:04.253172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 10:14:04.253172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 10:14:04.253172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:14:04.253172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 441/904] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:04.259004 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:04.371640 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0d1ea-cbe9-49d7-a397-52004f3321a7 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:04.407998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:04.408652 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:04.408933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:04.409210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:04.409932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:04.410237 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:04.411650 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:04.423007 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 464/905] 10.222.0.67 () {56 vars in 1109 bytes} [Wed May 25 10:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:04.429093 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:04.536857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992136ed-d3a3-46bb-9764-75a5082051ff None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:04.551096 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:04.574788 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:04.575954 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:04.576258 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:04.576537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:04.587801 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:04.590040 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 10:14:04.605302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application with Lock( May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:04.606378 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: ERROR keystone.server.flask.application May 25 10:14:04.607342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 442/906] 10.222.0.67 () {56 vars in 1111 bytes} [Wed May 25 10:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:04.612662 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:04.662768 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:04.727781 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc09e4-3367-44fa-9c79-2a4d0448c482 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:04.765268 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72753202-9e67-4702-a590-715a43d37fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:04.765928 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72753202-9e67-4702-a590-715a43d37fac None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:04.766209 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72753202-9e67-4702-a590-715a43d37fac None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:04.766488 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72753202-9e67-4702-a590-715a43d37fac None admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:04.767414 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72753202-9e67-4702-a590-715a43d37fac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:04.767723 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72753202-9e67-4702-a590-715a43d37fac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:04.769163 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72753202-9e67-4702-a590-715a43d37fac None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:04.781728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 465/907] 10.222.0.67 () {56 vars in 1148 bytes} [Wed May 25 10:14:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:04.788903 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:04.906140 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f210b50-b984-4bca-a961-ba0d3a6471f9 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:04.946931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a64b1-6504-45a3-b57b-e35845519d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:04.947618 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a64b1-6504-45a3-b57b-e35845519d5f None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:04.947904 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a64b1-6504-45a3-b57b-e35845519d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:04.948187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a64b1-6504-45a3-b57b-e35845519d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:04.949034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a64b1-6504-45a3-b57b-e35845519d5f None admin] RBAC: Adding query filter params (role.id=079434fe84194c03ae64e10d61e222e6, scope.project.id=061cceafef044884ad92a96749c79856, user.id=1c4c0e33447e4a70be3de0256513ef51) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:04.949351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a64b1-6504-45a3-b57b-e35845519d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:04.950950 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a64b1-6504-45a3-b57b-e35845519d5f None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:04.956965 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 443/908] 10.222.0.67 () {56 vars in 1374 bytes} [Wed May 25 10:14:04 2022] GET /identity/v3/role_assignments?user.id=1c4c0e33447e4a70be3de0256513ef51&scope.project.id=061cceafef044884ad92a96749c79856&role.id=079434fe84194c03ae64e10d61e222e6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:07.250914 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c586-3ec6-4e58-abc6-956c244717cb None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:07.251542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c586-3ec6-4e58-abc6-956c244717cb None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:07.251542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c586-3ec6-4e58-abc6-956c244717cb None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:07.252886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 466/909] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:14:07.259386 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9c8d-9006-43ca-b5c8-c6c8e7802b90 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:07.259838 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9c8d-9006-43ca-b5c8-c6c8e7802b90 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:07.259988 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9c8d-9006-43ca-b5c8-c6c8e7802b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:07.278623 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0f2e9c8d-9006-43ca-b5c8-c6c8e7802b90 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:14:07.279916 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0f2e9c8d-9006-43ca-b5c8-c6c8e7802b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:14:07.310302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:07.355547 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 444/910] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:14:07 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:14:07.379378 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c586-3ec6-4e58-abc6-956c244717cb None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:07.482886 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c586-3ec6-4e58-abc6-956c244717cb None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:07.490966 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:07.522041 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:07.522779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:07.523056 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:07.523410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] PATH_INFO: `/v3/services/placement` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:07.524009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:07.525403 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:07.537617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:07.539897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:07.540797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 467/911] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 10:14:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:07.546741 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9c8d-9006-43ca-b5c8-c6c8e7802b90 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:07.673938 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9c8d-9006-43ca-b5c8-c6c8e7802b90 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:07.711374 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e818b50-ad13-45f9-83e1-c25b9573cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:07.712051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818b50-ad13-45f9-83e1-c25b9573cda7 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:07.712341 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818b50-ad13-45f9-83e1-c25b9573cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:07.712619 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e818b50-ad13-45f9-83e1-c25b9573cda7 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:07.713335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e818b50-ad13-45f9-83e1-c25b9573cda7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:07.713643 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e818b50-ad13-45f9-83e1-c25b9573cda7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:07.715036 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e818b50-ad13-45f9-83e1-c25b9573cda7 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:07.720282 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 445/912] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 10:14:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:07.726377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:07.833576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da27d-634f-4777-9024-6f46d4a5fe8c None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:07.869283 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a70ad-bd3e-4548-bf73-cd29f6f205c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:07.869950 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a70ad-bd3e-4548-bf73-cd29f6f205c6 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:07.870221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a70ad-bd3e-4548-bf73-cd29f6f205c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:07.870502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a70ad-bd3e-4548-bf73-cd29f6f205c6 None admin] PATH_INFO: `/v3/services` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:07.871217 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a70ad-bd3e-4548-bf73-cd29f6f205c6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:07.871564 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a70ad-bd3e-4548-bf73-cd29f6f205c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:07.872951 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a70ad-bd3e-4548-bf73-cd29f6f205c6 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:07.877682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 468/913] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 10:14:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:10.114169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669a6de-3246-4e1a-bb66-9fbe2802a1f9 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:10.115012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669a6de-3246-4e1a-bb66-9fbe2802a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:10.115012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669a6de-3246-4e1a-bb66-9fbe2802a1f9 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:10.117182 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 446/914] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:14:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:14:10.127232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ead23-2121-4715-8a80-1faa8c163f93 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:10.127748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ead23-2121-4715-8a80-1faa8c163f93 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:10.127839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ead23-2121-4715-8a80-1faa8c163f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:10.149426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-f36ead23-2121-4715-8a80-1faa8c163f93 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:14:10.150644 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-f36ead23-2121-4715-8a80-1faa8c163f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:14:10.179469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:10.221394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 469/915] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:14:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:14:10.246077 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669a6de-3246-4e1a-bb66-9fbe2802a1f9 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:10.287181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:10.367375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669a6de-3246-4e1a-bb66-9fbe2802a1f9 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:10.404607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b2fbd-e463-44b2-8b6e-3470a7b42a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:10.405273 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2fbd-e463-44b2-8b6e-3470a7b42a1a None admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:10.405609 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2fbd-e463-44b2-8b6e-3470a7b42a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:10.405893 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2fbd-e463-44b2-8b6e-3470a7b42a1a None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:10.406627 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2fbd-e463-44b2-8b6e-3470a7b42a1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:10.408187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2fbd-e463-44b2-8b6e-3470a7b42a1a None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:10.424587 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 447/916] 10.222.0.67 () {60 vars in 1141 bytes} [Wed May 25 10:14:10 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:14:12.782551 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d751d3-ec9d-4d45-bc13-8adf703ea56a None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:12.783224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d751d3-ec9d-4d45-bc13-8adf703ea56a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:12.783224 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d751d3-ec9d-4d45-bc13-8adf703ea56a None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:12.784512 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 470/917] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:14:12.791540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024036aa-8f50-4c77-8e4b-1039759bb819 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:12.792072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024036aa-8f50-4c77-8e4b-1039759bb819 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:12.792263 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024036aa-8f50-4c77-8e4b-1039759bb819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:12.816356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-024036aa-8f50-4c77-8e4b-1039759bb819 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:14:12.817566 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-024036aa-8f50-4c77-8e4b-1039759bb819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:14:12.894705 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 448/918] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:14:12 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 10:14:12.919567 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d751d3-ec9d-4d45-bc13-8adf703ea56a None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:13.043204 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d751d3-ec9d-4d45-bc13-8adf703ea56a None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:13.085695 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:13.086533 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:13.086820 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:13.087104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] PATH_INFO: `/v3/services/placement` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:13.087804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:13.089210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:13.103479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:13.104631 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:13.110011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 471/919] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 10:14:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:13.116540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024036aa-8f50-4c77-8e4b-1039759bb819 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:13.138875 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:13.225611 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024036aa-8f50-4c77-8e4b-1039759bb819 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:13.262795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:13.263576 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:13.263857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:13.264135 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:13.264875 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:13.265188 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:13.266653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:13.271869 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 449/920] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 10:14:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:13.279292 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:13.320546 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:13.398077 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb1d93-a59e-4e78-b91f-92875f3afefd None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:13.439034 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce9b8-b9af-4b3f-ab6f-fec213934243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:13.440193 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce9b8-b9af-4b3f-ab6f-fec213934243 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:13.440691 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce9b8-b9af-4b3f-ab6f-fec213934243 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:13.441184 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce9b8-b9af-4b3f-ab6f-fec213934243 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:13.442612 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce9b8-b9af-4b3f-ab6f-fec213934243 None admin] RBAC: Adding query filter params (interface=public, service_id=5c6a3ffce505445b8e09d2ca658b5fac, region_id=RegionOne) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:13.443173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce9b8-b9af-4b3f-ab6f-fec213934243 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:13.444895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce9b8-b9af-4b3f-ab6f-fec213934243 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:13.451827 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 472/921] 10.222.0.67 () {56 vars in 1251 bytes} [Wed May 25 10:14:13 2022] GET /identity/v3/endpoints?service_id=5c6a3ffce505445b8e09d2ca658b5fac&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:13.458552 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:13.550418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:13.571423 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd465d-96c8-45f2-8211-535449c1e861 None admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:13.606912 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e418f6-bfeb-4414-aa34-8323e55b48d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:13.607615 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e418f6-bfeb-4414-aa34-8323e55b48d9 None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:13.607914 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e418f6-bfeb-4414-aa34-8323e55b48d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:13.608192 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e418f6-bfeb-4414-aa34-8323e55b48d9 None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:13.608871 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e418f6-bfeb-4414-aa34-8323e55b48d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:13.610258 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e418f6-bfeb-4414-aa34-8323e55b48d9 None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:13.616956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 450/922] 10.222.0.67 () {56 vars in 1087 bytes} [Wed May 25 10:14:13 2022] GET /identity/v3/services => generated 1962 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:14:15.900050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff786-7d23-43b7-abd5-9bf24e4557e2 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:15.900609 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff786-7d23-43b7-abd5-9bf24e4557e2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:15.900609 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff786-7d23-43b7-abd5-9bf24e4557e2 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:15.902759 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 473/923] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:14:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:14:15.908828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b46e5-8091-47a6-afe6-895843aa9174 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:15.909289 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b46e5-8091-47a6-afe6-895843aa9174 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:15.909379 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b46e5-8091-47a6-afe6-895843aa9174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:15.927497 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-921b46e5-8091-47a6-afe6-895843aa9174 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:14:15.928681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-921b46e5-8091-47a6-afe6-895843aa9174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:14:15.999571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 451/924] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:14:15 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 10:14:16.028819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff786-7d23-43b7-abd5-9bf24e4557e2 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:16.140106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:16.150467 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff786-7d23-43b7-abd5-9bf24e4557e2 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:16.185502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:16.186299 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:16.186589 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:16.186868 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:16.187883 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:16.189295 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 10:14:16.201412 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 10:14:16.202519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.get_or_create( May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application with Lock( May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self._enter() May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application return self.creator() May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application created_value = creator( May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: ERROR keystone.server.flask.application May 25 10:14:16.203494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 474/925] 10.222.0.67 () {56 vars in 1117 bytes} [Wed May 25 10:14:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 10:14:16.210294 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b46e5-8091-47a6-afe6-895843aa9174 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:16.291134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:16.317851 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b46e5-8091-47a6-afe6-895843aa9174 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:16.363441 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658f7e-b80e-4ed9-aa4e-c09573914cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:16.364106 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658f7e-b80e-4ed9-aa4e-c09573914cad None admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:16.364395 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658f7e-b80e-4ed9-aa4e-c09573914cad None admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:16.364680 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658f7e-b80e-4ed9-aa4e-c09573914cad None admin] PATH_INFO: `/v3/services` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:16.365392 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658f7e-b80e-4ed9-aa4e-c09573914cad None admin] RBAC: Adding query filter params (name=placement) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:14:16.365701 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658f7e-b80e-4ed9-aa4e-c09573914cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:16.367111 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658f7e-b80e-4ed9-aa4e-c09573914cad None admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:16.372821 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 452/926] 10.222.0.67 () {56 vars in 1116 bytes} [Wed May 25 10:14:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:14:16.379060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:14:16.492077 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a4bbc-8644-4d85-83ef-823909434805 None admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:14:16.528047 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084d352-5850-440a-a729-f9984b0579be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:14:16.528770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084d352-5850-440a-a729-f9984b0579be None admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:14:16.529058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084d352-5850-440a-a729-f9984b0579be None admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:14:16.529327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084d352-5850-440a-a729-f9984b0579be None admin] PATH_INFO: `/v3/endpoints` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:14:16.530067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084d352-5850-440a-a729-f9984b0579be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:14:16.531497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084d352-5850-440a-a729-f9984b0579be None admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:14:16.560338 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 475/927] 10.222.0.67 () {60 vars in 1144 bytes} [Wed May 25 10:14:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:14:26.369276 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=30 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:14:26.551859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:15:16.353626 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997a05-c055-40b0-a757-9c39c21b83fa None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:16.354155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997a05-c055-40b0-a757-9c39c21b83fa None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:16.354155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03997a05-c055-40b0-a757-9c39c21b83fa None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:16.355898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 453/928] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:16.361459 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0c2c5-0ffe-4216-89bd-ebb59c92bfe9 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:16.361917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0c2c5-0ffe-4216-89bd-ebb59c92bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:16.362008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0c2c5-0ffe-4216-89bd-ebb59c92bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:16.382514 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-20f0c2c5-0ffe-4216-89bd-ebb59c92bfe9 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:16.383824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-20f0c2c5-0ffe-4216-89bd-ebb59c92bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:16.476053 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 476/929] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:15:16.526727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e771-caeb-47ef-a1c4-207637702ec4 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:16.527008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e771-caeb-47ef-a1c4-207637702ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:16.527310 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7e771-caeb-47ef-a1c4-207637702ec4 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:16.528831 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 454/930] 10.222.0.67 () {54 vars in 964 bytes} [Wed May 25 10:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:16.535949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc4a5-43d7-4ca2-b93c-13f1d626ba54 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:16.536238 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc4a5-43d7-4ca2-b93c-13f1d626ba54 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:16.536513 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bc4a5-43d7-4ca2-b93c-13f1d626ba54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:16.608986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-dc0bc4a5-43d7-4ca2-b93c-13f1d626ba54 None None] MFA Rules not processed for user `fa4af93cd76845db97b72cfb27664bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:16.611032 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-dc0bc4a5-43d7-4ca2-b93c-13f1d626ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:16.678343 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 477/931] 10.222.0.67 () {58 vars in 1061 bytes} [Wed May 25 10:15:16 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:16.687121 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e771-caeb-47ef-a1c4-207637702ec4 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:16.698707 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7e771-caeb-47ef-a1c4-207637702ec4 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:16.702303 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a01498-3bd4-4a2c-929c-c706f0f1fc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:16.703008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01498-3bd4-4a2c-929c-c706f0f1fc92 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:16.703408 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01498-3bd4-4a2c-929c-c706f0f1fc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:16.703693 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a01498-3bd4-4a2c-929c-c706f0f1fc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:16.713342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a01498-3bd4-4a2c-929c-c706f0f1fc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:16.714804 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a01498-3bd4-4a2c-929c-c706f0f1fc92 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:16.725242 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 455/932] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:19.242462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f28318-4edd-4867-a450-f62c1c7e1cb0 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:19.243050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f28318-4edd-4867-a450-f62c1c7e1cb0 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:19.243050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f28318-4edd-4867-a450-f62c1c7e1cb0 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:19.244421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 478/933] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:19.250276 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710c1f-6924-48af-93e9-51d6c7a74fb5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:19.250700 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710c1f-6924-48af-93e9-51d6c7a74fb5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:19.250846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee710c1f-6924-48af-93e9-51d6c7a74fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:19.270249 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-ee710c1f-6924-48af-93e9-51d6c7a74fb5 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:19.271536 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-ee710c1f-6924-48af-93e9-51d6c7a74fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:19.280854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 456/934] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:19.322354 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f28318-4edd-4867-a450-f62c1c7e1cb0 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:19.334824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f28318-4edd-4867-a450-f62c1c7e1cb0 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:19.338916 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396df3fd-35b5-4ccd-a2b6-6c1e56158af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:19.339622 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df3fd-35b5-4ccd-a2b6-6c1e56158af3 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:19.339908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df3fd-35b5-4ccd-a2b6-6c1e56158af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:19.340188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df3fd-35b5-4ccd-a2b6-6c1e56158af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:19.349857 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396df3fd-35b5-4ccd-a2b6-6c1e56158af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:19.351352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396df3fd-35b5-4ccd-a2b6-6c1e56158af3 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:19.360762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 479/935] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:21.983477 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8e9a-ac2c-4f95-8a7d-e8f09f10794e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:21.984495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8e9a-ac2c-4f95-8a7d-e8f09f10794e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:21.984607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b8e9a-ac2c-4f95-8a7d-e8f09f10794e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:21.986210 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 457/936] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:21.991388 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7952df-2bdf-4a4b-b251-5468e59c6439 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:21.991829 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7952df-2bdf-4a4b-b251-5468e59c6439 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:21.991920 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7952df-2bdf-4a4b-b251-5468e59c6439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:22.036838 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5a7952df-2bdf-4a4b-b251-5468e59c6439 None None] MFA Rules not processed for user `89587fceb82a48d69851e13e14ad9293`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:22.037950 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5a7952df-2bdf-4a4b-b251-5468e59c6439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:22.080375 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:15:22.109888 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 480/937] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:21 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:22.151722 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b8e9a-ac2c-4f95-8a7d-e8f09f10794e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:22.164204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b8e9a-ac2c-4f95-8a7d-e8f09f10794e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:22.168169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd1596-8337-4798-9eec-f493e54b8f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:22.168939 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd1596-8337-4798-9eec-f493e54b8f5c service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:22.169349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd1596-8337-4798-9eec-f493e54b8f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:22.169731 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd1596-8337-4798-9eec-f493e54b8f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:22.180035 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd1596-8337-4798-9eec-f493e54b8f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:22.181618 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd1596-8337-4798-9eec-f493e54b8f5c service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:22.193332 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 458/938] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:22 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:25.080259 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc981-eb1b-4802-ae44-7b6a5af99930 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:25.080828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc981-eb1b-4802-ae44-7b6a5af99930 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:25.080828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc981-eb1b-4802-ae44-7b6a5af99930 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:25.082081 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 481/939] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:25.088699 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c6b26-6b77-4ea7-8927-d284ec6ea664 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:25.089385 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c6b26-6b77-4ea7-8927-d284ec6ea664 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:25.089574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c6b26-6b77-4ea7-8927-d284ec6ea664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:25.116760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3e7c6b26-6b77-4ea7-8927-d284ec6ea664 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:25.117975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3e7c6b26-6b77-4ea7-8927-d284ec6ea664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:25.189420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 459/940] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:25 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:25.232451 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc981-eb1b-4802-ae44-7b6a5af99930 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:25.251773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc981-eb1b-4802-ae44-7b6a5af99930 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:25.258775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159c455-4a5f-4e72-a94d-d38df0d54ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:25.259794 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159c455-4a5f-4e72-a94d-d38df0d54ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:25.260186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159c455-4a5f-4e72-a94d-d38df0d54ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:25.260570 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159c455-4a5f-4e72-a94d-d38df0d54ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:25.272103 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159c455-4a5f-4e72-a94d-d38df0d54ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:25.273555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159c455-4a5f-4e72-a94d-d38df0d54ad4 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:25.283200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 482/941] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:25 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:28.263144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fb836-7834-4839-b323-e9dd84c0458b None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:28.263776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fb836-7834-4839-b323-e9dd84c0458b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:28.263776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fb836-7834-4839-b323-e9dd84c0458b None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:28.265196 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 460/942] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:28.270957 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198da1b3-2e4f-4dff-86eb-41cdbbc9ea95 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:28.271371 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198da1b3-2e4f-4dff-86eb-41cdbbc9ea95 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:28.271579 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198da1b3-2e4f-4dff-86eb-41cdbbc9ea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:28.290516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-198da1b3-2e4f-4dff-86eb-41cdbbc9ea95 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:28.291758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-198da1b3-2e4f-4dff-86eb-41cdbbc9ea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:28.300382 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 483/943] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:28.353986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33190eb-a2e5-45cf-875a-22d54b76cb5d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:28.354287 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33190eb-a2e5-45cf-875a-22d54b76cb5d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:28.354557 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33190eb-a2e5-45cf-875a-22d54b76cb5d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:28.356005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 461/944] 10.222.0.67 () {54 vars in 964 bytes} [Wed May 25 10:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:28.362029 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030395-0f53-404b-a949-0e12a85a910e None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:28.362326 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030395-0f53-404b-a949-0e12a85a910e None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:28.362604 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030395-0f53-404b-a949-0e12a85a910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:28.382458 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-59030395-0f53-404b-a949-0e12a85a910e None None] MFA Rules not processed for user `fa4af93cd76845db97b72cfb27664bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:28.383710 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-59030395-0f53-404b-a949-0e12a85a910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:28.391588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 484/945] 10.222.0.67 () {58 vars in 1061 bytes} [Wed May 25 10:15:28 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:28.400307 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33190eb-a2e5-45cf-875a-22d54b76cb5d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:28.412446 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33190eb-a2e5-45cf-875a-22d54b76cb5d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:28.416839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7309b7-b864-4bf1-b110-3e1402bd44d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:28.417484 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7309b7-b864-4bf1-b110-3e1402bd44d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:28.417770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7309b7-b864-4bf1-b110-3e1402bd44d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:28.418041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7309b7-b864-4bf1-b110-3e1402bd44d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:28.427630 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7309b7-b864-4bf1-b110-3e1402bd44d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:28.429073 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7309b7-b864-4bf1-b110-3e1402bd44d4 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:28.439267 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 462/946] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:30.990399 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853aa67-010d-4973-b189-1753689e673c None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:30.990999 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853aa67-010d-4973-b189-1753689e673c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:30.991453 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853aa67-010d-4973-b189-1753689e673c None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:30.994054 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 485/947] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:31.002773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61fca-383c-4121-b04c-243bac121eec None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:31.003472 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61fca-383c-4121-b04c-243bac121eec None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:31.003572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61fca-383c-4121-b04c-243bac121eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:31.025616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c2d61fca-383c-4121-b04c-243bac121eec None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:31.026869 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c2d61fca-383c-4121-b04c-243bac121eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:31.034994 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 463/948] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:31.073336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853aa67-010d-4973-b189-1753689e673c None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:31.085548 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853aa67-010d-4973-b189-1753689e673c None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:31.089504 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad920e24-cf38-447d-83b5-7bd676189b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:31.090155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920e24-cf38-447d-83b5-7bd676189b90 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:31.090437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920e24-cf38-447d-83b5-7bd676189b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:31.090712 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad920e24-cf38-447d-83b5-7bd676189b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:31.100220 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad920e24-cf38-447d-83b5-7bd676189b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:31.101667 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad920e24-cf38-447d-83b5-7bd676189b90 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:31.111332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 486/949] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:33.444407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2aff0-3003-49ce-99f0-5860e7279a6c None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:33.444961 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2aff0-3003-49ce-99f0-5860e7279a6c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:33.444961 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2aff0-3003-49ce-99f0-5860e7279a6c None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:33.446540 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 464/950] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:33.452277 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cde06-faf0-4e78-bdb1-f34d5fff3c9d None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:33.452803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cde06-faf0-4e78-bdb1-f34d5fff3c9d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:33.452890 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cde06-faf0-4e78-bdb1-f34d5fff3c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:33.473347 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-565cde06-faf0-4e78-bdb1-f34d5fff3c9d None None] MFA Rules not processed for user `89587fceb82a48d69851e13e14ad9293`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:33.474556 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-565cde06-faf0-4e78-bdb1-f34d5fff3c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:33.486648 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 487/951] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:33 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:33.524503 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2aff0-3003-49ce-99f0-5860e7279a6c None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:33.535578 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2aff0-3003-49ce-99f0-5860e7279a6c None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:33.539128 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781b8a5-4912-498b-94ea-03661e27a3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:33.539873 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781b8a5-4912-498b-94ea-03661e27a3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:33.540238 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781b8a5-4912-498b-94ea-03661e27a3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:33.540574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781b8a5-4912-498b-94ea-03661e27a3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:33.550781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781b8a5-4912-498b-94ea-03661e27a3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:33.552376 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781b8a5-4912-498b-94ea-03661e27a3d7 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:33.562486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 465/952] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:33 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:36.238142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce68d-5ca2-4d6a-a7ae-572668627450 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:36.238704 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce68d-5ca2-4d6a-a7ae-572668627450 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:36.238704 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ce68d-5ca2-4d6a-a7ae-572668627450 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:36.240077 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 488/953] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:36.245504 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac54d-0ec7-4cc5-ad26-e1290a7a8a48 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:36.245923 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac54d-0ec7-4cc5-ad26-e1290a7a8a48 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:36.246131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ac54d-0ec7-4cc5-ad26-e1290a7a8a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:36.266028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4e6ac54d-0ec7-4cc5-ad26-e1290a7a8a48 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:36.267305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4e6ac54d-0ec7-4cc5-ad26-e1290a7a8a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:36.276585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 466/954] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:36.315617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce68d-5ca2-4d6a-a7ae-572668627450 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:36.327752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ce68d-5ca2-4d6a-a7ae-572668627450 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:36.331688 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d319af8-82c1-414a-a73b-9af0f24b25d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:36.332336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d319af8-82c1-414a-a73b-9af0f24b25d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:36.332613 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d319af8-82c1-414a-a73b-9af0f24b25d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:36.332891 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d319af8-82c1-414a-a73b-9af0f24b25d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:36.342136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d319af8-82c1-414a-a73b-9af0f24b25d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:36.343660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d319af8-82c1-414a-a73b-9af0f24b25d0 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:36.353383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 489/955] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:38.636239 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6009c3-2ad6-4a23-bd5f-43208f4f5916 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:38.636805 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6009c3-2ad6-4a23-bd5f-43208f4f5916 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:38.636805 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6009c3-2ad6-4a23-bd5f-43208f4f5916 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:38.638167 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 467/956] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:38.643865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29b0f-8843-4457-a362-050372cc92b8 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:38.644289 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29b0f-8843-4457-a362-050372cc92b8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:38.644426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29b0f-8843-4457-a362-050372cc92b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:38.663394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-a2c29b0f-8843-4457-a362-050372cc92b8 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:38.664639 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-a2c29b0f-8843-4457-a362-050372cc92b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:38.673262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 490/957] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:38.715250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6009c3-2ad6-4a23-bd5f-43208f4f5916 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:38.726907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6009c3-2ad6-4a23-bd5f-43208f4f5916 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:38.730713 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80a5f2-5356-437d-a0af-f537bbdcddae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:38.731380 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a5f2-5356-437d-a0af-f537bbdcddae service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:38.731661 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a5f2-5356-437d-a0af-f537bbdcddae service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:38.731930 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a5f2-5356-437d-a0af-f537bbdcddae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:38.741267 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80a5f2-5356-437d-a0af-f537bbdcddae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:38.742698 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80a5f2-5356-437d-a0af-f537bbdcddae service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:38.752472 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 468/958] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:41.495788 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e599-7776-4a7d-9b8e-36888aa974de None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:41.496379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e599-7776-4a7d-9b8e-36888aa974de None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:41.496379 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4e599-7776-4a7d-9b8e-36888aa974de None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:41.497770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 491/959] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:41.504556 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c8dfa-4101-4143-8136-a62f5680d284 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:41.505257 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c8dfa-4101-4143-8136-a62f5680d284 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:41.505473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c8dfa-4101-4143-8136-a62f5680d284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:41.528171 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-701c8dfa-4101-4143-8136-a62f5680d284 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:41.529457 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-701c8dfa-4101-4143-8136-a62f5680d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:41.538971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 469/960] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:41 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:41.576317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4e599-7776-4a7d-9b8e-36888aa974de None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:41.595800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4e599-7776-4a7d-9b8e-36888aa974de None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:41.602048 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dc4db-64ac-4e40-a6ad-2a8f9c489842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:41.603020 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dc4db-64ac-4e40-a6ad-2a8f9c489842 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:41.603494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dc4db-64ac-4e40-a6ad-2a8f9c489842 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:41.603900 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dc4db-64ac-4e40-a6ad-2a8f9c489842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:41.615706 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dc4db-64ac-4e40-a6ad-2a8f9c489842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:41.617157 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dc4db-64ac-4e40-a6ad-2a8f9c489842 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:41.627704 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 492/961] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:41 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:46.045078 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bf009-b228-4e4f-b24a-aff08d75f8b7 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:46.045767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bf009-b228-4e4f-b24a-aff08d75f8b7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:46.045767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bf009-b228-4e4f-b24a-aff08d75f8b7 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:46.047244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 470/962] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:46.052600 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2844-7a2a-4997-962b-5945b9d879ff None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:46.053044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2844-7a2a-4997-962b-5945b9d879ff None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:46.053136 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2844-7a2a-4997-962b-5945b9d879ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:46.072571 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-baca2844-7a2a-4997-962b-5945b9d879ff None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:46.073791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-baca2844-7a2a-4997-962b-5945b9d879ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:46.082499 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 493/963] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:46.123193 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bf009-b228-4e4f-b24a-aff08d75f8b7 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:46.135494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bf009-b228-4e4f-b24a-aff08d75f8b7 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:46.139753 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47150d6-94c1-43e7-b89c-376ae3ffae63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:46.140351 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47150d6-94c1-43e7-b89c-376ae3ffae63 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:46.140634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47150d6-94c1-43e7-b89c-376ae3ffae63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:46.140911 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47150d6-94c1-43e7-b89c-376ae3ffae63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:46.149983 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47150d6-94c1-43e7-b89c-376ae3ffae63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:46.151449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47150d6-94c1-43e7-b89c-376ae3ffae63 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:46.160866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 471/964] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:15:49.037153 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f87c6-954a-4707-96b4-c23954b9baa0 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:49.037663 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f87c6-954a-4707-96b4-c23954b9baa0 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:49.037752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f87c6-954a-4707-96b4-c23954b9baa0 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:49.039083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 494/965] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:49.044477 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be46a21-5db9-4c4e-8b83-9639ec45da5a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:49.044949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be46a21-5db9-4c4e-8b83-9639ec45da5a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:49.045043 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be46a21-5db9-4c4e-8b83-9639ec45da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:49.051396 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=80 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:15:49.063907 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2be46a21-5db9-4c4e-8b83-9639ec45da5a None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:49.065094 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2be46a21-5db9-4c4e-8b83-9639ec45da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:49.073442 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 472/966] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:49 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:49.111109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f87c6-954a-4707-96b4-c23954b9baa0 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:49.123755 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f87c6-954a-4707-96b4-c23954b9baa0 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:49.128276 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4366d-999b-408c-9609-d76848d5fc01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:49.128933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4366d-999b-408c-9609-d76848d5fc01 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:49.129221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4366d-999b-408c-9609-d76848d5fc01 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:49.129487 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4366d-999b-408c-9609-d76848d5fc01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:49.139381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4366d-999b-408c-9609-d76848d5fc01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:49.140829 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4366d-999b-408c-9609-d76848d5fc01 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:49.150790 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 495/967] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:49 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:53.464127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2d21-2fa7-470f-a22d-e2e3fc93b073 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:53.464757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2d21-2fa7-470f-a22d-e2e3fc93b073 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:53.464757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2d21-2fa7-470f-a22d-e2e3fc93b073 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:53.466764 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 473/968] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:53.472555 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9742-18a4-44c9-82e0-05d2cfc723dc None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:53.473011 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9742-18a4-44c9-82e0-05d2cfc723dc None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:53.473117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a9742-18a4-44c9-82e0-05d2cfc723dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:53.480044 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=57 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:15:53.494222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-584a9742-18a4-44c9-82e0-05d2cfc723dc None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:53.495496 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-584a9742-18a4-44c9-82e0-05d2cfc723dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:53.504832 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 496/969] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:15:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:15:53.550051 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2d21-2fa7-470f-a22d-e2e3fc93b073 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:15:53.562547 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2d21-2fa7-470f-a22d-e2e3fc93b073 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:15:53.566495 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd327-d504-49dd-b6b7-31b6b99df1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:15:53.567152 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd327-d504-49dd-b6b7-31b6b99df1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:53.567482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd327-d504-49dd-b6b7-31b6b99df1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:53.567765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd327-d504-49dd-b6b7-31b6b99df1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:53.577070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd327-d504-49dd-b6b7-31b6b99df1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:15:53.578453 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acd327-d504-49dd-b6b7-31b6b99df1b6 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:15:53.587936 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 474/970] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:15:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:15:59.085384 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdcfb0-e8a6-401c-a8c5-7a2a3c346fc5 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:59.085899 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdcfb0-e8a6-401c-a8c5-7a2a3c346fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:59.086003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdcfb0-e8a6-401c-a8c5-7a2a3c346fc5 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:59.087727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 497/971] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:15:59.093582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10570a8d-69c0-4d88-9bcc-e72764ab30ce None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:15:59.094031 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10570a8d-69c0-4d88-9bcc-e72764ab30ce None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:15:59.094120 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10570a8d-69c0-4d88-9bcc-e72764ab30ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:15:59.137346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-10570a8d-69c0-4d88-9bcc-e72764ab30ce None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:15:59.138754 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-10570a8d-69c0-4d88-9bcc-e72764ab30ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:15:59.241270 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 475/972] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:15:59 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:03.488703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=2 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:16:03.606149 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc81f6-eceb-4e37-9cc6-257229cf4418 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:03.606431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc81f6-eceb-4e37-9cc6-257229cf4418 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:03.606906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc81f6-eceb-4e37-9cc6-257229cf4418 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:03.608397 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 498/973] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:03.615160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b16728-e350-47ef-a8c3-3f2ddbe8b565 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:03.615700 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b16728-e350-47ef-a8c3-3f2ddbe8b565 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:03.615794 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b16728-e350-47ef-a8c3-3f2ddbe8b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:03.634830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-35b16728-e350-47ef-a8c3-3f2ddbe8b565 None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:03.636319 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-35b16728-e350-47ef-a8c3-3f2ddbe8b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:03.646070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 476/974] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:16:03 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:05.191710 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439338-7193-4563-8b80-f0cec1b9f4b9 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:05.192307 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439338-7193-4563-8b80-f0cec1b9f4b9 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:05.192307 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8439338-7193-4563-8b80-f0cec1b9f4b9 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:05.193609 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 499/975] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:05.198535 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2250d-c511-4e02-8cc4-bad7da89e811 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:05.199355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2250d-c511-4e02-8cc4-bad7da89e811 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:05.199643 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2250d-c511-4e02-8cc4-bad7da89e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:05.218202 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dec2250d-c511-4e02-8cc4-bad7da89e811 None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:05.219416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dec2250d-c511-4e02-8cc4-bad7da89e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:05.228435 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 477/976] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:16:05 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:09.363524 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47a7a-79e9-4712-a3a0-7235298c8a30 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:09.364066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47a7a-79e9-4712-a3a0-7235298c8a30 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:09.364066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a47a7a-79e9-4712-a3a0-7235298c8a30 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:09.370682 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd577-4bbf-4650-980b-28e2dad90c6c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:09.371723 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd577-4bbf-4650-980b-28e2dad90c6c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:09.372043 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd577-4bbf-4650-980b-28e2dad90c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:09.374182 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 500/977] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:09.393975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-947fd577-4bbf-4650-980b-28e2dad90c6c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:09.395585 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-947fd577-4bbf-4650-980b-28e2dad90c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:09.404539 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 478/978] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:16:09.463583 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf190b0-c860-43b0-b8b2-30208a6b109d None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:09.464428 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf190b0-c860-43b0-b8b2-30208a6b109d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:09.465038 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf190b0-c860-43b0-b8b2-30208a6b109d None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:09.468409 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 501/979] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 10:16:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:09.479474 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677d6f-496f-4d78-9023-8e82896da654 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:09.479812 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677d6f-496f-4d78-9023-8e82896da654 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:09.480131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d677d6f-496f-4d78-9023-8e82896da654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:09.522157 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3d677d6f-496f-4d78-9023-8e82896da654 None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:09.523464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3d677d6f-496f-4d78-9023-8e82896da654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:09.599355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 479/980] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 10:16:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:09.607155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf190b0-c860-43b0-b8b2-30208a6b109d None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:09.621342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf190b0-c860-43b0-b8b2-30208a6b109d None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:09.626498 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a6175-c087-473c-ac72-a26e57e5daf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:09.627305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a6175-c087-473c-ac72-a26e57e5daf9 service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:09.627741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a6175-c087-473c-ac72-a26e57e5daf9 service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:09.628133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a6175-c087-473c-ac72-a26e57e5daf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:09.636872 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a6175-c087-473c-ac72-a26e57e5daf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:09.638849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a6175-c087-473c-ac72-a26e57e5daf9 service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:09.649946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 502/981] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:16:12.117283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453e50-46c6-4e72-8aa7-4b228a853a6d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:12.117807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453e50-46c6-4e72-8aa7-4b228a853a6d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:12.117807 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f453e50-46c6-4e72-8aa7-4b228a853a6d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:12.119344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 480/982] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:12.124741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64e0d-dfe5-4be4-b678-2940aac1275a None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:12.125179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64e0d-dfe5-4be4-b678-2940aac1275a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:12.125256 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b64e0d-dfe5-4be4-b678-2940aac1275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:12.143392 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-e7b64e0d-dfe5-4be4-b678-2940aac1275a None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:12.144595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e7b64e0d-dfe5-4be4-b678-2940aac1275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:12.153360 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 503/983] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:12.200726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453e50-46c6-4e72-8aa7-4b228a853a6d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:12.214684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f453e50-46c6-4e72-8aa7-4b228a853a6d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:12.220012 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33135a05-1dae-4d52-8b7c-d121a24fcc9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:12.220766 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135a05-1dae-4d52-8b7c-d121a24fcc9e service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:12.221123 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135a05-1dae-4d52-8b7c-d121a24fcc9e service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:12.221473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135a05-1dae-4d52-8b7c-d121a24fcc9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:12.230329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33135a05-1dae-4d52-8b7c-d121a24fcc9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:12.232302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33135a05-1dae-4d52-8b7c-d121a24fcc9e service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:12.236502 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:16:12.245924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 481/984] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:14.866505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3078789-4678-4b05-b2f8-bc6cf2cdec4d None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:14.867066 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3078789-4678-4b05-b2f8-bc6cf2cdec4d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:14.868588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3078789-4678-4b05-b2f8-bc6cf2cdec4d None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:14.870787 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 504/985] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:14.881001 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d198c-2003-4223-b55e-6a4359119879 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:14.881524 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d198c-2003-4223-b55e-6a4359119879 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:14.881634 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d198c-2003-4223-b55e-6a4359119879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:14.918956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-be7d198c-2003-4223-b55e-6a4359119879 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:14.920653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-be7d198c-2003-4223-b55e-6a4359119879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:14.928940 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 482/986] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:14.976408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280333-d953-4537-9128-149b56183b12 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:14.976940 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280333-d953-4537-9128-149b56183b12 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:14.977236 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280333-d953-4537-9128-149b56183b12 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:14.978632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 505/987] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 10:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:14.984480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d52f0-2e75-468d-b9b1-8dab190c8c81 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:14.984769 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d52f0-2e75-468d-b9b1-8dab190c8c81 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:14.985048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d52f0-2e75-468d-b9b1-8dab190c8c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:15.003673 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8a9d52f0-2e75-468d-b9b1-8dab190c8c81 None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:15.004854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8a9d52f0-2e75-468d-b9b1-8dab190c8c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:15.014144 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 483/988] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 10:16:14 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:15.022116 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da280333-d953-4537-9128-149b56183b12 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:15.036481 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da280333-d953-4537-9128-149b56183b12 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:15.041721 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415cbd5-3414-44c3-b8bd-f4c21f08a8ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:15.042365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415cbd5-3414-44c3-b8bd-f4c21f08a8ff service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:15.042650 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415cbd5-3414-44c3-b8bd-f4c21f08a8ff service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:15.042925 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415cbd5-3414-44c3-b8bd-f4c21f08a8ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:15.051416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415cbd5-3414-44c3-b8bd-f4c21f08a8ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:15.053013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415cbd5-3414-44c3-b8bd-f4c21f08a8ff service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:15.062509 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 506/989] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:17.460574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3748a9-2737-450a-a5c1-e94a5859e2fb None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:17.461638 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3748a9-2737-450a-a5c1-e94a5859e2fb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:17.462122 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3748a9-2737-450a-a5c1-e94a5859e2fb None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:17.468167 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 484/990] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:17.469684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7c9c-8148-41c6-aa09-1c483965e554 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:17.470094 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7c9c-8148-41c6-aa09-1c483965e554 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:17.470278 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc7c9c-8148-41c6-aa09-1c483965e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:17.489014 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-4bfc7c9c-8148-41c6-aa09-1c483965e554 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:17.490545 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-4bfc7c9c-8148-41c6-aa09-1c483965e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:17.503591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 507/991] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:17.547828 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3748a9-2737-450a-a5c1-e94a5859e2fb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:17.573004 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3748a9-2737-450a-a5c1-e94a5859e2fb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:17.578981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57a622-ca7a-4b09-be3f-72e011d5e58b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:17.580196 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a622-ca7a-4b09-be3f-72e011d5e58b service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:17.580717 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a622-ca7a-4b09-be3f-72e011d5e58b service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:17.581510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57a622-ca7a-4b09-be3f-72e011d5e58b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:17.593580 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57a622-ca7a-4b09-be3f-72e011d5e58b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:17.595198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57a622-ca7a-4b09-be3f-72e011d5e58b service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:17.605499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 485/992] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:19.373410 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a11e-d6a1-4cb5-a368-906f4a71e454 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:19.373970 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a11e-d6a1-4cb5-a368-906f4a71e454 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:19.373970 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a11e-d6a1-4cb5-a368-906f4a71e454 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:19.379298 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 508/993] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:19.380970 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590d16f-9d3a-47e1-b5cf-de1dcfbdb759 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:19.381990 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590d16f-9d3a-47e1-b5cf-de1dcfbdb759 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:19.382448 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590d16f-9d3a-47e1-b5cf-de1dcfbdb759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:19.402381 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-c590d16f-9d3a-47e1-b5cf-de1dcfbdb759 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:19.403829 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c590d16f-9d3a-47e1-b5cf-de1dcfbdb759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:19.415434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 486/994] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:16:19.728509 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cddb6-35df-4ada-bebb-7e7735eee8a4 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:19.728746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cddb6-35df-4ada-bebb-7e7735eee8a4 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:19.729037 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cddb6-35df-4ada-bebb-7e7735eee8a4 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:19.730772 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 509/995] 10.222.0.67 () {54 vars in 963 bytes} [Wed May 25 10:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:19.736733 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2b7b-20ef-4c27-82b6-7506544a9bb3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:19.736990 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2b7b-20ef-4c27-82b6-7506544a9bb3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:19.737255 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2b7b-20ef-4c27-82b6-7506544a9bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:19.777789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-15eb2b7b-20ef-4c27-82b6-7506544a9bb3 None None] MFA Rules not processed for user `ccd4c1e5951840048c6e647a88787ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:19.779082 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-15eb2b7b-20ef-4c27-82b6-7506544a9bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:19.855890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 487/996] 10.222.0.67 () {58 vars in 1060 bytes} [Wed May 25 10:16:19 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:19.863753 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cddb6-35df-4ada-bebb-7e7735eee8a4 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:19.875426 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cddb6-35df-4ada-bebb-7e7735eee8a4 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:19.879158 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77beef0c-88c2-4a6d-b7ba-3617651525cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccd4c1e5951840048c6e647a88787ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:19.879908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beef0c-88c2-4a6d-b7ba-3617651525cc service cinder] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:19.880289 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beef0c-88c2-4a6d-b7ba-3617651525cc service cinder] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:19.880639 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77beef0c-88c2-4a6d-b7ba-3617651525cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:19.890697 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beef0c-88c2-4a6d-b7ba-3617651525cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:19.892383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77beef0c-88c2-4a6d-b7ba-3617651525cc service cinder] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:19.902978 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 510/997] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:20.027646 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421601-6087-4505-9719-9973a4ef7c2e None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:20.028194 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421601-6087-4505-9719-9973a4ef7c2e None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:20.028661 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c421601-6087-4505-9719-9973a4ef7c2e None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:20.030202 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 488/998] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:20.035746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c296-7ade-4a73-9d2f-e6b82542911c None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:20.036004 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c296-7ade-4a73-9d2f-e6b82542911c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:20.036315 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c296-7ade-4a73-9d2f-e6b82542911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:20.054741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-a339c296-7ade-4a73-9d2f-e6b82542911c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:20.055977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-a339c296-7ade-4a73-9d2f-e6b82542911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:20.065043 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 511/999] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:20.111820 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421601-6087-4505-9719-9973a4ef7c2e None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:20.126304 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c421601-6087-4505-9719-9973a4ef7c2e None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:20.132586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273804c2-3698-4b0c-8f43-15033b5c0639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:20.133244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273804c2-3698-4b0c-8f43-15033b5c0639 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:20.133522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273804c2-3698-4b0c-8f43-15033b5c0639 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:20.133795 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273804c2-3698-4b0c-8f43-15033b5c0639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:20.143009 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273804c2-3698-4b0c-8f43-15033b5c0639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:20.144670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273804c2-3698-4b0c-8f43-15033b5c0639 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:20.154693 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 489/1000] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:22.494987 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca507d0-eb8b-419c-86b4-7b51f812fc01 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:22.495591 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca507d0-eb8b-419c-86b4-7b51f812fc01 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:22.495701 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca507d0-eb8b-419c-86b4-7b51f812fc01 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:22.497109 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 512/1001] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:22.502770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43403448-b955-47d2-b014-31c5ff639417 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:22.503222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43403448-b955-47d2-b014-31c5ff639417 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:22.503391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43403448-b955-47d2-b014-31c5ff639417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:22.522486 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-43403448-b955-47d2-b014-31c5ff639417 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:22.523820 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-43403448-b955-47d2-b014-31c5ff639417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:22.533384 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 490/1002] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:22.579501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca507d0-eb8b-419c-86b4-7b51f812fc01 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:22.593718 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca507d0-eb8b-419c-86b4-7b51f812fc01 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:22.598497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75682fd-cb18-40e7-8f9f-eb73bc8606f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:22.599346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75682fd-cb18-40e7-8f9f-eb73bc8606f2 service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:22.599461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75682fd-cb18-40e7-8f9f-eb73bc8606f2 service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:22.599714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75682fd-cb18-40e7-8f9f-eb73bc8606f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:22.608793 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75682fd-cb18-40e7-8f9f-eb73bc8606f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:22.610435 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75682fd-cb18-40e7-8f9f-eb73bc8606f2 service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:22.620428 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 513/1003] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:24.974062 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f323ba4-fc24-48b5-b082-6a492a6730dd None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:24.974644 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f323ba4-fc24-48b5-b082-6a492a6730dd None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:24.974644 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f323ba4-fc24-48b5-b082-6a492a6730dd None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:24.976028 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 491/1004] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:24.981406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1e92a-4163-401d-b333-51d633ec67f2 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:24.981801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1e92a-4163-401d-b333-51d633ec67f2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:24.981905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1e92a-4163-401d-b333-51d633ec67f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:25.000031 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-fce1e92a-4163-401d-b333-51d633ec67f2 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:25.001230 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-fce1e92a-4163-401d-b333-51d633ec67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:25.009768 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 514/1005] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:25.053134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f323ba4-fc24-48b5-b082-6a492a6730dd None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:25.068437 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f323ba4-fc24-48b5-b082-6a492a6730dd None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:25.073940 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f9112-f9d1-4cca-a8af-1e04ded5ba6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:25.074827 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9112-f9d1-4cca-a8af-1e04ded5ba6c service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:25.075328 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9112-f9d1-4cca-a8af-1e04ded5ba6c service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:25.075876 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f9112-f9d1-4cca-a8af-1e04ded5ba6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:25.084749 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9112-f9d1-4cca-a8af-1e04ded5ba6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:25.086550 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f9112-f9d1-4cca-a8af-1e04ded5ba6c service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:25.097000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 492/1006] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:27.360308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f6f34-993b-4210-a874-f269d115262c None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:27.361234 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f6f34-993b-4210-a874-f269d115262c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:27.361501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f6f34-993b-4210-a874-f269d115262c None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:27.363047 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 515/1007] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:27.368572 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9a81-97d5-4477-8d20-ac0394a08f7b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:27.369021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9a81-97d5-4477-8d20-ac0394a08f7b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:27.369104 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9a81-97d5-4477-8d20-ac0394a08f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:27.387717 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7f1b9a81-97d5-4477-8d20-ac0394a08f7b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:27.388979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7f1b9a81-97d5-4477-8d20-ac0394a08f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:27.397492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 493/1008] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:27.444901 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f6f34-993b-4210-a874-f269d115262c None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:27.461242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f6f34-993b-4210-a874-f269d115262c None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:27.467698 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70522da8-0d3f-402d-a124-4932b8e4d2c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:27.468543 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70522da8-0d3f-402d-a124-4932b8e4d2c5 service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:27.468840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70522da8-0d3f-402d-a124-4932b8e4d2c5 service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:27.469103 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70522da8-0d3f-402d-a124-4932b8e4d2c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:27.478485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70522da8-0d3f-402d-a124-4932b8e4d2c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:27.480149 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70522da8-0d3f-402d-a124-4932b8e4d2c5 service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:27.490544 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 516/1009] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:30.138046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5140fb-002f-4406-a9b3-f254f991fb38 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:30.138703 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5140fb-002f-4406-a9b3-f254f991fb38 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:30.139031 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5140fb-002f-4406-a9b3-f254f991fb38 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:30.140487 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 494/1010] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:16:30.146310 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef39912-7cf6-42de-8562-99b953ada8a4 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:30.146739 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef39912-7cf6-42de-8562-99b953ada8a4 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:30.146849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef39912-7cf6-42de-8562-99b953ada8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:30.165778 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-2ef39912-7cf6-42de-8562-99b953ada8a4 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:30.166977 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-2ef39912-7cf6-42de-8562-99b953ada8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:30.175364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 517/1011] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:30.224349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5140fb-002f-4406-a9b3-f254f991fb38 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:30.240050 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5140fb-002f-4406-a9b3-f254f991fb38 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:30.245794 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168de337-5c88-4e6b-bf9d-b76791647687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:30.246491 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de337-5c88-4e6b-bf9d-b76791647687 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:30.246776 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de337-5c88-4e6b-bf9d-b76791647687 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:30.247064 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168de337-5c88-4e6b-bf9d-b76791647687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:30.256187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168de337-5c88-4e6b-bf9d-b76791647687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:30.257814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168de337-5c88-4e6b-bf9d-b76791647687 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:30.267719 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 495/1012] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:32.920802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e556b-f917-4a01-9a3e-501cc361947f None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:32.922585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e556b-f917-4a01-9a3e-501cc361947f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:32.922585 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e556b-f917-4a01-9a3e-501cc361947f None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:32.922901 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 518/1013] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:16:32.928894 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250bba-2ac0-4f6d-bd0b-8f67e8fbe2be None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:32.929406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250bba-2ac0-4f6d-bd0b-8f67e8fbe2be None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:32.929406 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a250bba-2ac0-4f6d-bd0b-8f67e8fbe2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:32.948909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3a250bba-2ac0-4f6d-bd0b-8f67e8fbe2be None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:32.950146 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3a250bba-2ac0-4f6d-bd0b-8f67e8fbe2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:32.958949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 496/1014] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:33.006721 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e556b-f917-4a01-9a3e-501cc361947f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:33.021580 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e556b-f917-4a01-9a3e-501cc361947f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:33.026787 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70c5aa-cc34-4355-a369-d171c48768fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:33.027576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70c5aa-cc34-4355-a369-d171c48768fd service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:33.027918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70c5aa-cc34-4355-a369-d171c48768fd service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:33.028199 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70c5aa-cc34-4355-a369-d171c48768fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:33.037221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70c5aa-cc34-4355-a369-d171c48768fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:33.038839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70c5aa-cc34-4355-a369-d171c48768fd service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:33.048815 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 519/1015] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:35.764896 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2815-b8b6-4db3-85bc-96347be8d2a8 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:35.765863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2815-b8b6-4db3-85bc-96347be8d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:35.766142 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2815-b8b6-4db3-85bc-96347be8d2a8 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:35.767616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 497/1016] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:35.773927 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c194-e436-4da9-bafc-b2a5e7cc1c2e None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:35.774433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c194-e436-4da9-bafc-b2a5e7cc1c2e None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:35.774433 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c194-e436-4da9-bafc-b2a5e7cc1c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:35.781613 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=52 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:16:35.794010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-4e42c194-e436-4da9-bafc-b2a5e7cc1c2e None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:35.795196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-4e42c194-e436-4da9-bafc-b2a5e7cc1c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:35.804087 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 520/1017] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:35.852645 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb2815-b8b6-4db3-85bc-96347be8d2a8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:35.867444 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb2815-b8b6-4db3-85bc-96347be8d2a8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:35.872909 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bfb24-0c79-4e77-88b4-534a85c6a65b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:35.873567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bfb24-0c79-4e77-88b4-534a85c6a65b service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:35.873846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bfb24-0c79-4e77-88b4-534a85c6a65b service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:35.874125 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bfb24-0c79-4e77-88b4-534a85c6a65b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:35.883551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bfb24-0c79-4e77-88b4-534a85c6a65b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:35.885148 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bfb24-0c79-4e77-88b4-534a85c6a65b service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:35.895166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 498/1018] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:36.041632 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f1cf-4737-4817-9aa3-c70842cfc4cc None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:36.041871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f1cf-4737-4817-9aa3-c70842cfc4cc None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:36.042096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9f1cf-4737-4817-9aa3-c70842cfc4cc None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:36.043542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 521/1019] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:36.050293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3aaf2-f220-4cdc-b211-61f1767ad9a2 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:36.050583 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3aaf2-f220-4cdc-b211-61f1767ad9a2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:36.050864 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3aaf2-f220-4cdc-b211-61f1767ad9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:36.071141 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f0d3aaf2-f220-4cdc-b211-61f1767ad9a2 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:36.072420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f0d3aaf2-f220-4cdc-b211-61f1767ad9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:36.081973 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 499/1020] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:36.143457 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb012-56a3-4626-bca9-b02d365531a7 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:36.143722 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb012-56a3-4626-bca9-b02d365531a7 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:36.144146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eb012-56a3-4626-bca9-b02d365531a7 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:36.145554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 522/1021] 10.222.0.67 () {54 vars in 962 bytes} [Wed May 25 10:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:36.150918 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048700c4-92c2-4379-9d63-8eacab6304fb None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:36.151207 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048700c4-92c2-4379-9d63-8eacab6304fb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:36.151532 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048700c4-92c2-4379-9d63-8eacab6304fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:36.191770 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-048700c4-92c2-4379-9d63-8eacab6304fb None None] MFA Rules not processed for user `edb9cb2a1c8047a8b6b08d3a9df09a36`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:36.192984 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-048700c4-92c2-4379-9d63-8eacab6304fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:36.207750 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:16:36.258561 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 500/1022] 10.222.0.67 () {58 vars in 1059 bytes} [Wed May 25 10:16:36 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:36.266107 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eb012-56a3-4626-bca9-b02d365531a7 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:36.277363 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eb012-56a3-4626-bca9-b02d365531a7 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:36.281147 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75769d-0fb2-43b3-8ab5-8c1580948bce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb9cb2a1c8047a8b6b08d3a9df09a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:36.281824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75769d-0fb2-43b3-8ab5-8c1580948bce service glance] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:36.282105 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75769d-0fb2-43b3-8ab5-8c1580948bce service glance] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:36.282450 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75769d-0fb2-43b3-8ab5-8c1580948bce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:36.292416 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75769d-0fb2-43b3-8ab5-8c1580948bce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:36.293794 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75769d-0fb2-43b3-8ab5-8c1580948bce service glance] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:36.303809 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 523/1023] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:38.258052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016692e-4b67-41db-b943-69061f0592ab None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:38.258767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016692e-4b67-41db-b943-69061f0592ab None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:38.258767 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016692e-4b67-41db-b943-69061f0592ab None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:38.260214 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 501/1024] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:38.265517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393b831-77bb-45cd-9818-5eaa4736ab56 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:38.266539 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393b831-77bb-45cd-9818-5eaa4736ab56 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:38.266797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393b831-77bb-45cd-9818-5eaa4736ab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:38.286630 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5393b831-77bb-45cd-9818-5eaa4736ab56 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:38.287999 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5393b831-77bb-45cd-9818-5eaa4736ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:38.297138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 524/1025] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:16:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:38.344560 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016692e-4b67-41db-b943-69061f0592ab None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:38.363128 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016692e-4b67-41db-b943-69061f0592ab None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:38.368311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bad5b2-1f4f-4f28-9757-f122e9c3d563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:38.368970 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad5b2-1f4f-4f28-9757-f122e9c3d563 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:38.369270 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad5b2-1f4f-4f28-9757-f122e9c3d563 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:38.369546 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bad5b2-1f4f-4f28-9757-f122e9c3d563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:38.381837 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bad5b2-1f4f-4f28-9757-f122e9c3d563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:38.383520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bad5b2-1f4f-4f28-9757-f122e9c3d563 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:38.394111 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 502/1026] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:48.280523 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=11 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:16:48.389353 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=24 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:16:51.668851 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb276-2755-4876-9f77-99ed4c536892 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:51.669512 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb276-2755-4876-9f77-99ed4c536892 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:51.669512 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cb276-2755-4876-9f77-99ed4c536892 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:51.670762 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 525/1027] 10.222.0.67 () {54 vars in 918 bytes} [Wed May 25 10:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:51.677432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4291e09-e83d-49ac-b660-c02d1542c960 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:51.678219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4291e09-e83d-49ac-b660-c02d1542c960 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:51.678394 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4291e09-e83d-49ac-b660-c02d1542c960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:51.707868 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f4291e09-e83d-49ac-b660-c02d1542c960 None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:51.716844 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f4291e09-e83d-49ac-b660-c02d1542c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:51.726048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 503/1028] 10.222.0.67 () {58 vars in 1015 bytes} [Wed May 25 10:16:51 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:51.740748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c472-ac6a-45ad-aa89-a7706b49b010 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:51.741043 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c472-ac6a-45ad-aa89-a7706b49b010 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:51.741331 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42c472-ac6a-45ad-aa89-a7706b49b010 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:51.742698 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 526/1029] 10.222.0.67 () {54 vars in 918 bytes} [Wed May 25 10:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:51.747440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382666e-65a1-4693-a683-fde261b88dd3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:51.747714 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382666e-65a1-4693-a683-fde261b88dd3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:51.747991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382666e-65a1-4693-a683-fde261b88dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:51.772410 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-9382666e-65a1-4693-a683-fde261b88dd3 None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:51.773574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9382666e-65a1-4693-a683-fde261b88dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:51.782345 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 504/1030] 10.222.0.67 () {58 vars in 1015 bytes} [Wed May 25 10:16:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:54.550105 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bb6ef-7d95-45fb-bef9-26cae99402e2 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:54.550749 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bb6ef-7d95-45fb-bef9-26cae99402e2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:54.550749 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bb6ef-7d95-45fb-bef9-26cae99402e2 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:54.552225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 527/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:54.557742 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59650-06d6-46c4-9fb9-31cf958425ac None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:54.558230 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59650-06d6-46c4-9fb9-31cf958425ac None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:54.558339 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59650-06d6-46c4-9fb9-31cf958425ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:54.577505 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-adc59650-06d6-46c4-9fb9-31cf958425ac None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:54.578739 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-adc59650-06d6-46c4-9fb9-31cf958425ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:54.587149 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 505/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:16:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:54.632478 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bb6ef-7d95-45fb-bef9-26cae99402e2 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:54.649525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bb6ef-7d95-45fb-bef9-26cae99402e2 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:54.655781 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08e607-e960-42d1-9b98-5fefa9f4f94c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:54.656444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e607-e960-42d1-9b98-5fefa9f4f94c service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:54.656734 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e607-e960-42d1-9b98-5fefa9f4f94c service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:54.657016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e607-e960-42d1-9b98-5fefa9f4f94c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:54.666441 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08e607-e960-42d1-9b98-5fefa9f4f94c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:54.668133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08e607-e960-42d1-9b98-5fefa9f4f94c service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:54.678741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 528/1033] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:55.732760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478301-68dc-40c9-9216-e2c70171a1d2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:55.733416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478301-68dc-40c9-9216-e2c70171a1d2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:55.733416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478301-68dc-40c9-9216-e2c70171a1d2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:55.734757 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 506/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:55.740937 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1552d-0000-4339-8bab-a2f56acdedac None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:55.741510 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1552d-0000-4339-8bab-a2f56acdedac None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:55.741510 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1552d-0000-4339-8bab-a2f56acdedac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:55.764155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-53c1552d-0000-4339-8bab-a2f56acdedac None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:55.765371 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-53c1552d-0000-4339-8bab-a2f56acdedac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:55.773664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 529/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:16:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:55.962169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478301-68dc-40c9-9216-e2c70171a1d2 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:55.980793 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478301-68dc-40c9-9216-e2c70171a1d2 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:55.985942 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc6d6f-579f-47bf-b57b-c970ce6d6fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:55.986602 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc6d6f-579f-47bf-b57b-c970ce6d6fcb service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:55.986959 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc6d6f-579f-47bf-b57b-c970ce6d6fcb service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:55.987237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc6d6f-579f-47bf-b57b-c970ce6d6fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:55.996055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc6d6f-579f-47bf-b57b-c970ce6d6fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:55.997660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc6d6f-579f-47bf-b57b-c970ce6d6fcb service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:56.007906 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 507/1036] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:56.958933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312dd1f-277c-46c3-8398-8d3cebedbede None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:56.959919 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312dd1f-277c-46c3-8398-8d3cebedbede None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:56.959919 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312dd1f-277c-46c3-8398-8d3cebedbede None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:56.963097 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 530/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:16:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:56.971433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e511c-dd71-47e5-ad02-5640d1fb0176 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:56.972183 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e511c-dd71-47e5-ad02-5640d1fb0176 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:56.972382 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e511c-dd71-47e5-ad02-5640d1fb0176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:56.997925 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-887e511c-dd71-47e5-ad02-5640d1fb0176 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:56.999148 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-887e511c-dd71-47e5-ad02-5640d1fb0176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:57.010199 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 508/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:16:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:57.167623 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312dd1f-277c-46c3-8398-8d3cebedbede None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:57.183696 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312dd1f-277c-46c3-8398-8d3cebedbede None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:57.189831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32009879-aa4c-4d3a-9b37-7f9319792a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:57.190479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009879-aa4c-4d3a-9b37-7f9319792a2a service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:57.190756 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009879-aa4c-4d3a-9b37-7f9319792a2a service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:57.191030 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009879-aa4c-4d3a-9b37-7f9319792a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:57.200417 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32009879-aa4c-4d3a-9b37-7f9319792a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:57.202067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32009879-aa4c-4d3a-9b37-7f9319792a2a service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:57.217525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 531/1039] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:58.142824 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172dd3-f65f-4352-b5d0-89ca46879edc None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:58.143393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172dd3-f65f-4352-b5d0-89ca46879edc None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:58.143393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d172dd3-f65f-4352-b5d0-89ca46879edc None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:58.144726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 509/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:58.150859 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3067ebb-face-45d9-b98a-127e7979b1ab None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:58.151625 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3067ebb-face-45d9-b98a-127e7979b1ab None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:58.151840 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3067ebb-face-45d9-b98a-127e7979b1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:58.177392 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-f3067ebb-face-45d9-b98a-127e7979b1ab None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:58.179205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-f3067ebb-face-45d9-b98a-127e7979b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:58.192050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 532/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:16:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:58.351198 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172dd3-f65f-4352-b5d0-89ca46879edc None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:58.366611 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d172dd3-f65f-4352-b5d0-89ca46879edc None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:58.371835 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0c368-4d02-40d3-a6fa-9be6fe72d573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:58.372492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0c368-4d02-40d3-a6fa-9be6fe72d573 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:58.372773 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0c368-4d02-40d3-a6fa-9be6fe72d573 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:58.373052 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0c368-4d02-40d3-a6fa-9be6fe72d573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:58.382412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0c368-4d02-40d3-a6fa-9be6fe72d573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:58.384076 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0c368-4d02-40d3-a6fa-9be6fe72d573 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:58.394524 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 510/1042] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:16:59.331695 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf635b-0481-4a20-99a8-85d02b4c2664 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:59.332399 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf635b-0481-4a20-99a8-85d02b4c2664 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:59.332399 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf635b-0481-4a20-99a8-85d02b4c2664 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:59.333690 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 533/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:16:59.340603 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf499-bf8c-47e2-96c9-a93e00e0e267 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:59.341131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf499-bf8c-47e2-96c9-a93e00e0e267 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:59.341131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf499-bf8c-47e2-96c9-a93e00e0e267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:59.359967 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-8d3bf499-bf8c-47e2-96c9-a93e00e0e267 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:16:59.361261 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8d3bf499-bf8c-47e2-96c9-a93e00e0e267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:16:59.370461 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 511/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:16:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:16:59.538373 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf635b-0481-4a20-99a8-85d02b4c2664 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:16:59.560485 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf635b-0481-4a20-99a8-85d02b4c2664 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:16:59.566774 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c160ab-b6ec-408d-8432-18d03564546d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:16:59.567517 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c160ab-b6ec-408d-8432-18d03564546d service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:16:59.567852 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c160ab-b6ec-408d-8432-18d03564546d service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:16:59.568180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c160ab-b6ec-408d-8432-18d03564546d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:16:59.578164 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c160ab-b6ec-408d-8432-18d03564546d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:16:59.580045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c160ab-b6ec-408d-8432-18d03564546d service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:16:59.591706 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 534/1045] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:16:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:00.452127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7aabc-fb9a-4360-9803-042c675c6542 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:00.452710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7aabc-fb9a-4360-9803-042c675c6542 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:00.452710 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7aabc-fb9a-4360-9803-042c675c6542 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:00.454072 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 512/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:00.459926 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631537-e2e8-421d-8fc4-d6a6b3e2d76b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:00.460593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631537-e2e8-421d-8fc4-d6a6b3e2d76b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:00.460738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631537-e2e8-421d-8fc4-d6a6b3e2d76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:00.481717 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-0e631537-e2e8-421d-8fc4-d6a6b3e2d76b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:00.483061 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-0e631537-e2e8-421d-8fc4-d6a6b3e2d76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:00.492401 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 535/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:17:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:00.675465 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7aabc-fb9a-4360-9803-042c675c6542 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:00.692088 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7aabc-fb9a-4360-9803-042c675c6542 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:00.698283 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6422e60-f3a0-4a21-a845-dfd6a90f741f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:00.699025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422e60-f3a0-4a21-a845-dfd6a90f741f service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:00.699403 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422e60-f3a0-4a21-a845-dfd6a90f741f service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:00.699725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422e60-f3a0-4a21-a845-dfd6a90f741f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:00.709783 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6422e60-f3a0-4a21-a845-dfd6a90f741f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:00.711360 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6422e60-f3a0-4a21-a845-dfd6a90f741f service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:00.721181 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 513/1048] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:01.689460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ff7c-bcd3-42e4-9fa0-39ff3a053b67 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:01.689460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ff7c-bcd3-42e4-9fa0-39ff3a053b67 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:01.689460 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123ff7c-bcd3-42e4-9fa0-39ff3a053b67 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:01.691389 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 536/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:01.697593 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1de05-a8b8-486c-a67f-9079a421cd7c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:01.698102 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1de05-a8b8-486c-a67f-9079a421cd7c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:01.698244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1de05-a8b8-486c-a67f-9079a421cd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:01.724157 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b3e1de05-a8b8-486c-a67f-9079a421cd7c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:01.725678 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b3e1de05-a8b8-486c-a67f-9079a421cd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:01.736426 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 514/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:17:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:01.905386 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123ff7c-bcd3-42e4-9fa0-39ff3a053b67 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:01.923546 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123ff7c-bcd3-42e4-9fa0-39ff3a053b67 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:01.930020 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fdbea-d3c0-4871-bf94-860420386302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:01.930789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdbea-d3c0-4871-bf94-860420386302 service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:01.931119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdbea-d3c0-4871-bf94-860420386302 service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:01.931489 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdbea-d3c0-4871-bf94-860420386302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:01.942828 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fdbea-d3c0-4871-bf94-860420386302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:01.944797 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fdbea-d3c0-4871-bf94-860420386302 service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:01.956854 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 537/1051] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:02.860735 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ca60-7bca-44e3-ac5b-10ed631b25b5 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:02.861355 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ca60-7bca-44e3-ac5b-10ed631b25b5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:02.861483 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ca60-7bca-44e3-ac5b-10ed631b25b5 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:02.862846 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 515/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:02.868497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a098-23d9-48d2-a5ff-7cdf2ec7819c None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:02.868947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a098-23d9-48d2-a5ff-7cdf2ec7819c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:02.869058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616a098-23d9-48d2-a5ff-7cdf2ec7819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:02.888682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-7616a098-23d9-48d2-a5ff-7cdf2ec7819c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:02.889905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-7616a098-23d9-48d2-a5ff-7cdf2ec7819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:02.899635 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 538/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:17:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:03.053448 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275ca60-7bca-44e3-ac5b-10ed631b25b5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:03.068729 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275ca60-7bca-44e3-ac5b-10ed631b25b5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:03.074797 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3c8a3-5f54-46f3-af35-e0c6077aeb46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:03.075424 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c8a3-5f54-46f3-af35-e0c6077aeb46 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:03.075711 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c8a3-5f54-46f3-af35-e0c6077aeb46 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:03.075982 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3c8a3-5f54-46f3-af35-e0c6077aeb46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:03.085091 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3c8a3-5f54-46f3-af35-e0c6077aeb46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:03.086721 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3c8a3-5f54-46f3-af35-e0c6077aeb46 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:03.096202 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 516/1054] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:03.957038 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ab338-0512-4bf0-8fec-321b5eea80d2 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:03.957600 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ab338-0512-4bf0-8fec-321b5eea80d2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:03.957600 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ab338-0512-4bf0-8fec-321b5eea80d2 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:03.958965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 539/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:03.964422 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a81cf-5dce-40a2-97ea-8b80f08f686c None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:03.964869 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a81cf-5dce-40a2-97ea-8b80f08f686c None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:03.964967 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a81cf-5dce-40a2-97ea-8b80f08f686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:03.984166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-6e6a81cf-5dce-40a2-97ea-8b80f08f686c None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:03.985375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-6e6a81cf-5dce-40a2-97ea-8b80f08f686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:03.994568 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 517/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:17:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:04.146824 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ab338-0512-4bf0-8fec-321b5eea80d2 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:04.161018 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ab338-0512-4bf0-8fec-321b5eea80d2 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:04.166164 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2e6f2-0cfe-4369-bdee-4e913656318e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:04.166799 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e6f2-0cfe-4369-bdee-4e913656318e service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:04.167154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e6f2-0cfe-4369-bdee-4e913656318e service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:04.167461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e6f2-0cfe-4369-bdee-4e913656318e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:04.175800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2e6f2-0cfe-4369-bdee-4e913656318e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:04.177378 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2e6f2-0cfe-4369-bdee-4e913656318e service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:04.187252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 540/1057] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:06.357438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ba61-004b-4954-b620-695840c12c32 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:06.358018 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ba61-004b-4954-b620-695840c12c32 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:06.358112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ba61-004b-4954-b620-695840c12c32 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:06.359645 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 518/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:06.365405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8641-ca4e-4004-811e-49eb2a48dfc4 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:06.365892 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8641-ca4e-4004-811e-49eb2a48dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:06.365986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8641-ca4e-4004-811e-49eb2a48dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:06.388090 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-9e6f8641-ca4e-4004-811e-49eb2a48dfc4 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:06.389322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-9e6f8641-ca4e-4004-811e-49eb2a48dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:06.399770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 541/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:06.443046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ba61-004b-4954-b620-695840c12c32 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:06.459982 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ba61-004b-4954-b620-695840c12c32 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:06.465931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1353e2-282f-4db4-9a20-87cde243a524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:06.466897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1353e2-282f-4db4-9a20-87cde243a524 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:06.467358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1353e2-282f-4db4-9a20-87cde243a524 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:06.467781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1353e2-282f-4db4-9a20-87cde243a524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:06.478914 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1353e2-282f-4db4-9a20-87cde243a524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:06.480439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1353e2-282f-4db4-9a20-87cde243a524 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:06.490226 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 519/1060] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:08.918771 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8bca-eb29-44df-8fd5-219964de925f None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:08.919361 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8bca-eb29-44df-8fd5-219964de925f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:08.919361 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc8bca-eb29-44df-8fd5-219964de925f None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:08.920728 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 542/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:08.926244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156e20-cf64-4730-b4af-6c1b3f50e9e5 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:08.926718 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156e20-cf64-4730-b4af-6c1b3f50e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:08.926843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e156e20-cf64-4730-b4af-6c1b3f50e9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:08.946558 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0e156e20-cf64-4730-b4af-6c1b3f50e9e5 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:08.947800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0e156e20-cf64-4730-b4af-6c1b3f50e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:08.956954 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 520/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:08.997827 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8bca-eb29-44df-8fd5-219964de925f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:09.010285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc8bca-eb29-44df-8fd5-219964de925f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:09.014357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9370c8-53b4-4bbb-bf65-5995c2d69a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:09.014998 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9370c8-53b4-4bbb-bf65-5995c2d69a52 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:09.015308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9370c8-53b4-4bbb-bf65-5995c2d69a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:09.015581 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9370c8-53b4-4bbb-bf65-5995c2d69a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:09.025250 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9370c8-53b4-4bbb-bf65-5995c2d69a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:09.026680 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9370c8-53b4-4bbb-bf65-5995c2d69a52 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:09.036334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 543/1063] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:11.606115 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14587b1-b284-44c4-a845-e29863ac554d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:11.606652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14587b1-b284-44c4-a845-e29863ac554d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:11.606652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14587b1-b284-44c4-a845-e29863ac554d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:11.608106 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 521/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:11.613844 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207877-0eb2-4b9b-b2a5-25e8385ef63d None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:11.614367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207877-0eb2-4b9b-b2a5-25e8385ef63d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:11.614367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2207877-0eb2-4b9b-b2a5-25e8385ef63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:11.633079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-e2207877-0eb2-4b9b-b2a5-25e8385ef63d None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:11.634279 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e2207877-0eb2-4b9b-b2a5-25e8385ef63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:11.642681 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 544/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:11.682771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14587b1-b284-44c4-a845-e29863ac554d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:11.695682 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14587b1-b284-44c4-a845-e29863ac554d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:11.699952 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75f437-be79-4c0c-a4e1-576bfea7c56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:11.700623 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75f437-be79-4c0c-a4e1-576bfea7c56c service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:11.700897 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75f437-be79-4c0c-a4e1-576bfea7c56c service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:11.701177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75f437-be79-4c0c-a4e1-576bfea7c56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:11.711579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75f437-be79-4c0c-a4e1-576bfea7c56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:11.713096 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75f437-be79-4c0c-a4e1-576bfea7c56c service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:11.723923 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 522/1066] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:14.231178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8377f9-2c5f-4da4-a2d1-a61df8f28e51 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:14.231821 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8377f9-2c5f-4da4-a2d1-a61df8f28e51 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:14.231821 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8377f9-2c5f-4da4-a2d1-a61df8f28e51 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:14.233213 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 545/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:14.239134 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c19b-96cd-4653-b6a3-23483b1d6689 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:14.239674 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c19b-96cd-4653-b6a3-23483b1d6689 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:14.239792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2c19b-96cd-4653-b6a3-23483b1d6689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:14.258622 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-95b2c19b-96cd-4653-b6a3-23483b1d6689 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:14.259860 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-95b2c19b-96cd-4653-b6a3-23483b1d6689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:14.268636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 523/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:14.311232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8377f9-2c5f-4da4-a2d1-a61df8f28e51 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:14.323837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8377f9-2c5f-4da4-a2d1-a61df8f28e51 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:14.327884 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e76aab-7ac5-47f4-a1c5-b3339a4881b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:14.328531 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e76aab-7ac5-47f4-a1c5-b3339a4881b0 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:14.328813 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e76aab-7ac5-47f4-a1c5-b3339a4881b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:14.329091 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e76aab-7ac5-47f4-a1c5-b3339a4881b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:14.340151 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e76aab-7ac5-47f4-a1c5-b3339a4881b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:14.341595 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e76aab-7ac5-47f4-a1c5-b3339a4881b0 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:14.351757 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 546/1069] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:16.686563 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f71c-c125-461a-9465-32e455318d55 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:16.687125 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f71c-c125-461a-9465-32e455318d55 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:16.687125 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f71c-c125-461a-9465-32e455318d55 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:16.689528 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 524/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:16.696494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17169fd0-5696-461f-8caa-863ea123341d None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:16.697041 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17169fd0-5696-461f-8caa-863ea123341d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:16.697041 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17169fd0-5696-461f-8caa-863ea123341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:16.715958 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-17169fd0-5696-461f-8caa-863ea123341d None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:16.717171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-17169fd0-5696-461f-8caa-863ea123341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:16.726078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 547/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:16.767340 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f71c-c125-461a-9465-32e455318d55 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:16.779208 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f71c-c125-461a-9465-32e455318d55 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:16.783855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbdc96-32ee-445d-98ba-6f12b2757d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:16.784522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbdc96-32ee-445d-98ba-6f12b2757d4d service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:16.784814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbdc96-32ee-445d-98ba-6f12b2757d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:16.785074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbdc96-32ee-445d-98ba-6f12b2757d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:16.795391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbdc96-32ee-445d-98ba-6f12b2757d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:16.796853 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbdc96-32ee-445d-98ba-6f12b2757d4d service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:16.808866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 525/1072] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:19.143521 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0328-2a7f-40fe-9550-a51fb9d81975 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:19.144059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0328-2a7f-40fe-9550-a51fb9d81975 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:19.144059 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a0328-2a7f-40fe-9550-a51fb9d81975 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:19.145442 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 548/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:19.151259 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a1d8-6ab3-42d9-aecf-dd773fc35d67 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:19.151745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a1d8-6ab3-42d9-aecf-dd773fc35d67 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:19.151840 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a1d8-6ab3-42d9-aecf-dd773fc35d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:19.158343 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=70 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:17:19.171865 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-4608a1d8-6ab3-42d9-aecf-dd773fc35d67 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:19.173160 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4608a1d8-6ab3-42d9-aecf-dd773fc35d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:19.185410 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 526/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:19.227096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a0328-2a7f-40fe-9550-a51fb9d81975 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:19.234559 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=64 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:17:19.243294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a0328-2a7f-40fe-9550-a51fb9d81975 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:19.247968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed9fcf-7913-4a54-af4e-c63e8db443fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:19.248928 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9fcf-7913-4a54-af4e-c63e8db443fd service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:19.249247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9fcf-7913-4a54-af4e-c63e8db443fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:19.249544 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed9fcf-7913-4a54-af4e-c63e8db443fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:19.260340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed9fcf-7913-4a54-af4e-c63e8db443fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:19.261806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed9fcf-7913-4a54-af4e-c63e8db443fd service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:19.271489 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 549/1075] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:21.611498 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433b11-fcd0-44c3-a182-1aaa9be82e77 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:21.612076 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433b11-fcd0-44c3-a182-1aaa9be82e77 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:21.612076 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13433b11-fcd0-44c3-a182-1aaa9be82e77 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:21.613413 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 527/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:21.618836 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e68f8-9ff4-438f-9c95-44316079a306 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:21.619262 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e68f8-9ff4-438f-9c95-44316079a306 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:21.619398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e68f8-9ff4-438f-9c95-44316079a306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:21.638935 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-4c7e68f8-9ff4-438f-9c95-44316079a306 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:21.640174 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-4c7e68f8-9ff4-438f-9c95-44316079a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:21.648860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 550/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:17:21.692602 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433b11-fcd0-44c3-a182-1aaa9be82e77 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:21.710011 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13433b11-fcd0-44c3-a182-1aaa9be82e77 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:21.714431 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3c07-f327-4193-909c-07388867a2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:21.715083 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3c07-f327-4193-909c-07388867a2ed service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:21.715402 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3c07-f327-4193-909c-07388867a2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:21.715682 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3c07-f327-4193-909c-07388867a2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:21.727736 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3c07-f327-4193-909c-07388867a2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:21.729191 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3c07-f327-4193-909c-07388867a2ed service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:21.739253 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 528/1078] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:24.039378 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111047-b22d-4124-acef-a64c6fe9ac09 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:24.039953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111047-b22d-4124-acef-a64c6fe9ac09 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:24.039953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f111047-b22d-4124-acef-a64c6fe9ac09 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:24.041242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 551/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:24.046970 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc0f7f-543b-4918-bf16-4484481b4cae None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:24.047409 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc0f7f-543b-4918-bf16-4484481b4cae None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:24.047564 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc0f7f-543b-4918-bf16-4484481b4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:24.069062 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2cfc0f7f-543b-4918-bf16-4484481b4cae None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:24.070282 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2cfc0f7f-543b-4918-bf16-4484481b4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:24.080254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 529/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:24.123124 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f111047-b22d-4124-acef-a64c6fe9ac09 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:24.136144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f111047-b22d-4124-acef-a64c6fe9ac09 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:24.140473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b988d00-ceab-4a78-a8e3-6244fa0790e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:24.141112 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b988d00-ceab-4a78-a8e3-6244fa0790e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:24.141392 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b988d00-ceab-4a78-a8e3-6244fa0790e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:24.141845 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b988d00-ceab-4a78-a8e3-6244fa0790e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:24.153874 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b988d00-ceab-4a78-a8e3-6244fa0790e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:24.156123 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b988d00-ceab-4a78-a8e3-6244fa0790e4 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:24.167469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 552/1081] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:26.448492 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c697d-a859-414f-adb9-101ac9d17bd6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:26.449360 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c697d-a859-414f-adb9-101ac9d17bd6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:26.449360 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c697d-a859-414f-adb9-101ac9d17bd6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:26.451520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 530/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:26.460837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8792f3-1693-4ef3-8f76-6081a5fe7e24 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:26.461284 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8792f3-1693-4ef3-8f76-6081a5fe7e24 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:26.461519 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8792f3-1693-4ef3-8f76-6081a5fe7e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:26.483864 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-9e8792f3-1693-4ef3-8f76-6081a5fe7e24 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:26.485081 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-9e8792f3-1693-4ef3-8f76-6081a5fe7e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:26.494846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 553/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:26.534292 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c697d-a859-414f-adb9-101ac9d17bd6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:26.547265 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c697d-a859-414f-adb9-101ac9d17bd6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:26.552884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8982c1d-a96c-4a5b-b224-300b06626064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:26.553565 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8982c1d-a96c-4a5b-b224-300b06626064 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:26.553848 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8982c1d-a96c-4a5b-b224-300b06626064 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:26.554124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8982c1d-a96c-4a5b-b224-300b06626064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:26.564687 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8982c1d-a96c-4a5b-b224-300b06626064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:26.566653 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8982c1d-a96c-4a5b-b224-300b06626064 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:26.576393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 531/1084] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:28.835177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e4e97-3ca2-457d-9027-27402a5f995f None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:28.835682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e4e97-3ca2-457d-9027-27402a5f995f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:28.835806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e4e97-3ca2-457d-9027-27402a5f995f None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:28.838008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 554/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:17:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:17:28.846529 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fb5b0-9c94-410c-8e46-e22f96087b76 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:28.847070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fb5b0-9c94-410c-8e46-e22f96087b76 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:28.847070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fb5b0-9c94-410c-8e46-e22f96087b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:28.873899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-2b8fb5b0-9c94-410c-8e46-e22f96087b76 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:17:28.875400 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2b8fb5b0-9c94-410c-8e46-e22f96087b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:17:28.887037 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 532/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:17:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:17:28.934668 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e4e97-3ca2-457d-9027-27402a5f995f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:17:28.950096 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e4e97-3ca2-457d-9027-27402a5f995f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:17:28.955634 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c71fcd8-3e97-443b-a386-633e8fe09475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:17:28.956626 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fcd8-3e97-443b-a386-633e8fe09475 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:17:28.956922 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fcd8-3e97-443b-a386-633e8fe09475 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:17:28.957200 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c71fcd8-3e97-443b-a386-633e8fe09475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:17:28.970473 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71fcd8-3e97-443b-a386-633e8fe09475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:17:28.972236 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c71fcd8-3e97-443b-a386-633e8fe09475 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:17:28.982173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 555/1087] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:17:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:17:38.865587 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=20 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:17:38.977710 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=23 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:18:04.256839 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3a9f-dd53-4bb4-ac64-538d02b51297 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:04.257480 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3a9f-dd53-4bb4-ac64-538d02b51297 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:04.257616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3a9f-dd53-4bb4-ac64-538d02b51297 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:04.259760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 533/1088] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:04.265789 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a8bd9-f322-42a5-bdf4-bbc5edb80809 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:04.266337 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a8bd9-f322-42a5-bdf4-bbc5edb80809 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:04.266337 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a8bd9-f322-42a5-bdf4-bbc5edb80809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:04.289058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-d18a8bd9-f322-42a5-bdf4-bbc5edb80809 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:04.290303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-d18a8bd9-f322-42a5-bdf4-bbc5edb80809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:04.299752 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 556/1089] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:18:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:04.355458 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db28f9e-524f-42b4-8365-9a335265a2ca None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:04.355863 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db28f9e-524f-42b4-8365-9a335265a2ca None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:04.356147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db28f9e-524f-42b4-8365-9a335265a2ca None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:04.357545 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 534/1090] 10.222.0.67 () {54 vars in 962 bytes} [Wed May 25 10:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:04.363703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73aed-708a-4d93-a06d-495320a072af None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:04.363995 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73aed-708a-4d93-a06d-495320a072af None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:04.364282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73aed-708a-4d93-a06d-495320a072af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:04.384340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-b3b73aed-708a-4d93-a06d-495320a072af None None] MFA Rules not processed for user `edb9cb2a1c8047a8b6b08d3a9df09a36`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:04.385586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-b3b73aed-708a-4d93-a06d-495320a072af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:04.393506 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 557/1091] 10.222.0.67 () {58 vars in 1059 bytes} [Wed May 25 10:18:04 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:04.401267 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db28f9e-524f-42b4-8365-9a335265a2ca None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:18:04.414161 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db28f9e-524f-42b4-8365-9a335265a2ca None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:18:04.417941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abacfa-a5cb-4c83-96c1-8cd7282dd088 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb9cb2a1c8047a8b6b08d3a9df09a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:18:04.418586 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abacfa-a5cb-4c83-96c1-8cd7282dd088 service glance] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:04.418872 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abacfa-a5cb-4c83-96c1-8cd7282dd088 service glance] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:04.419137 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abacfa-a5cb-4c83-96c1-8cd7282dd088 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:04.429255 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abacfa-a5cb-4c83-96c1-8cd7282dd088 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:18:04.430714 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abacfa-a5cb-4c83-96c1-8cd7282dd088 service glance] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:18:04.441233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 535/1092] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:18:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:18:06.867862 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc38d-3b5e-4dfd-abea-f3214af001f8 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:06.868411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc38d-3b5e-4dfd-abea-f3214af001f8 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:06.868529 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc38d-3b5e-4dfd-abea-f3214af001f8 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:06.870715 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 558/1093] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:06.877325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d20019-bc05-43b7-97dd-e06112c2acb8 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:06.878139 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d20019-bc05-43b7-97dd-e06112c2acb8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:06.878946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d20019-bc05-43b7-97dd-e06112c2acb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:06.902148 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-94d20019-bc05-43b7-97dd-e06112c2acb8 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:06.903790 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-94d20019-bc05-43b7-97dd-e06112c2acb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:06.913515 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 536/1094] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:18:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:06.940138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc38d-3b5e-4dfd-abea-f3214af001f8 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:18:06.955242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc38d-3b5e-4dfd-abea-f3214af001f8 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:18:06.961083 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fafb88-9097-49fe-98d6-809748b7f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:18:06.961775 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fafb88-9097-49fe-98d6-809748b7f9ea admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:06.962057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fafb88-9097-49fe-98d6-809748b7f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:06.962332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fafb88-9097-49fe-98d6-809748b7f9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:06.963045 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fafb88-9097-49fe-98d6-809748b7f9ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:18:06.964947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-68fafb88-9097-49fe-98d6-809748b7f9ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:18:06.964947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:18:06.964947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:18:06.966129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fafb88-9097-49fe-98d6-809748b7f9ea admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:18:06.986860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 559/1095] 10.222.0.67 () {56 vars in 1108 bytes} [Wed May 25 10:18:06 2022] GET /identity/v3/projects => generated 1606 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:18:09.295523 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd61f4-b351-4797-a5cd-a6d7050e9413 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:09.296169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd61f4-b351-4797-a5cd-a6d7050e9413 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:09.296169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd61f4-b351-4797-a5cd-a6d7050e9413 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:09.297494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 537/1096] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:09.303659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63802ef6-75a6-4777-a14a-93e1f530fd9a None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:09.304201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63802ef6-75a6-4777-a14a-93e1f530fd9a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:09.304201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63802ef6-75a6-4777-a14a-93e1f530fd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:09.322950 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-63802ef6-75a6-4777-a14a-93e1f530fd9a None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:09.324177 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-63802ef6-75a6-4777-a14a-93e1f530fd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:09.332846 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 560/1097] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:18:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:09.379792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd61f4-b351-4797-a5cd-a6d7050e9413 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:18:09.395145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd61f4-b351-4797-a5cd-a6d7050e9413 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:18:09.401439 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df234aef-8300-4414-b882-efc50cece32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:18:09.402127 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234aef-8300-4414-b882-efc50cece32a service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:09.402394 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234aef-8300-4414-b882-efc50cece32a service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:09.402714 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234aef-8300-4414-b882-efc50cece32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:09.412792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df234aef-8300-4414-b882-efc50cece32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:18:09.415155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df234aef-8300-4414-b882-efc50cece32a service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:18:09.425760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 538/1098] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:18:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:18:11.890303 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b08bf-3c05-488d-b794-818d6ead0658 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:11.891240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b08bf-3c05-488d-b794-818d6ead0658 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:11.891240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b08bf-3c05-488d-b794-818d6ead0658 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:11.893700 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 561/1099] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:18:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:11.899596 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59d282-91a1-4b4a-848a-399253abce2d None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:11.900043 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59d282-91a1-4b4a-848a-399253abce2d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:11.900180 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59d282-91a1-4b4a-848a-399253abce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:11.919624 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-fa59d282-91a1-4b4a-848a-399253abce2d None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:11.920889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fa59d282-91a1-4b4a-848a-399253abce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:11.930461 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 539/1100] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:18:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:11.968857 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b08bf-3c05-488d-b794-818d6ead0658 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:18:11.981340 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b08bf-3c05-488d-b794-818d6ead0658 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:18:11.985142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcb013-75df-4dd3-b9e5-7363ab512043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:18:11.985800 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcb013-75df-4dd3-b9e5-7363ab512043 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:11.986081 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcb013-75df-4dd3-b9e5-7363ab512043 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:11.986359 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcb013-75df-4dd3-b9e5-7363ab512043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:11.997179 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcb013-75df-4dd3-b9e5-7363ab512043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:18:11.998642 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcb013-75df-4dd3-b9e5-7363ab512043 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:18:12.010383 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 562/1101] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:18:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:18:14.351324 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6eff1-7d46-4668-b1b1-86548807d0c1 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:14.351903 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6eff1-7d46-4668-b1b1-86548807d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:14.351903 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6eff1-7d46-4668-b1b1-86548807d0c1 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:14.353299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 540/1102] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:14.358920 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7eb54-0483-441c-81c8-eaa192b038eb None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:14.359401 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7eb54-0483-441c-81c8-eaa192b038eb None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:14.359534 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7eb54-0483-441c-81c8-eaa192b038eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:14.379062 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-39a7eb54-0483-441c-81c8-eaa192b038eb None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:14.380332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-39a7eb54-0483-441c-81c8-eaa192b038eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:14.389033 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 563/1103] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:18:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:14.429518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6eff1-7d46-4668-b1b1-86548807d0c1 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:18:14.442771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6eff1-7d46-4668-b1b1-86548807d0c1 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:18:14.447184 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6983dd9-58dd-42b9-a5dc-e1eca388dff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:18:14.447885 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6983dd9-58dd-42b9-a5dc-e1eca388dff6 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:14.448173 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6983dd9-58dd-42b9-a5dc-e1eca388dff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:14.448455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6983dd9-58dd-42b9-a5dc-e1eca388dff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:14.465401 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6983dd9-58dd-42b9-a5dc-e1eca388dff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:18:14.466900 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6983dd9-58dd-42b9-a5dc-e1eca388dff6 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:18:14.478058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 541/1104] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:18:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:18:16.916297 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc443c4a-afdb-4294-90db-acd6973f04b5 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:16.916860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc443c4a-afdb-4294-90db-acd6973f04b5 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:16.916860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc443c4a-afdb-4294-90db-acd6973f04b5 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:16.918758 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 564/1105] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:16.926800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadb017-53c2-4e66-8c7b-291db2f4b5d1 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:16.927233 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadb017-53c2-4e66-8c7b-291db2f4b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:16.927399 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadb017-53c2-4e66-8c7b-291db2f4b5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:16.946740 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-faadb017-53c2-4e66-8c7b-291db2f4b5d1 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:16.947988 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-faadb017-53c2-4e66-8c7b-291db2f4b5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:16.957489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 542/1106] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:18:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:17.002180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc443c4a-afdb-4294-90db-acd6973f04b5 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:18:17.020733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc443c4a-afdb-4294-90db-acd6973f04b5 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:18:17.025117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa20580-9ff1-4884-b9d5-0fdb4d850715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:18:17.025763 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20580-9ff1-4884-b9d5-0fdb4d850715 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:17.026035 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20580-9ff1-4884-b9d5-0fdb4d850715 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:17.026305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa20580-9ff1-4884-b9d5-0fdb4d850715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:17.036205 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa20580-9ff1-4884-b9d5-0fdb4d850715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:18:17.037659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa20580-9ff1-4884-b9d5-0fdb4d850715 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:18:17.047372 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 565/1107] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:18:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:18:19.532587 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd243de-213d-4160-836b-ee1c356af9eb None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:19.533165 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd243de-213d-4160-836b-ee1c356af9eb None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:19.533165 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd243de-213d-4160-836b-ee1c356af9eb None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:19.535002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 543/1108] 10.222.0.67 () {54 vars in 926 bytes} [Wed May 25 10:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:18:19.540895 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f6e0-e78d-457f-b232-594269f3019f None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:19.541407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f6e0-e78d-457f-b232-594269f3019f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:19.541532 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f6e0-e78d-457f-b232-594269f3019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:19.562169 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-d220f6e0-e78d-457f-b232-594269f3019f None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:18:19.563782 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-d220f6e0-e78d-457f-b232-594269f3019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:18:19.572592 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 566/1109] 10.222.0.67 () {58 vars in 1023 bytes} [Wed May 25 10:18:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:18:19.613716 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd243de-213d-4160-836b-ee1c356af9eb None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:18:19.626208 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd243de-213d-4160-836b-ee1c356af9eb None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:18:19.631018 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1623a01-a8f1-4120-9443-7dc171e850c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:18:19.631707 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623a01-a8f1-4120-9443-7dc171e850c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:18:19.631989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623a01-a8f1-4120-9443-7dc171e850c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:18:19.632259 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1623a01-a8f1-4120-9443-7dc171e850c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:18:19.642678 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1623a01-a8f1-4120-9443-7dc171e850c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:18:19.644203 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1623a01-a8f1-4120-9443-7dc171e850c5 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:18:19.654475 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 544/1110] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:18:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:18:29.556073 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=33 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:18:29.650048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=33 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:20:02.535201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a0b1-e470-4e9e-bbd1-e8aa39f4d23d None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.536211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a0b1-e470-4e9e-bbd1-e8aa39f4d23d None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.536211 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3a0b1-e470-4e9e-bbd1-e8aa39f4d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.564683 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-91b3a0b1-e470-4e9e-bbd1-e8aa39f4d23d None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:20:02.565885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-91b3a0b1-e470-4e9e-bbd1-e8aa39f4d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:20:02.575103 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 567/1111] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:20:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:20:02.584726 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777455-5de0-4f59-b87d-32bca6a1699b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.585293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777455-5de0-4f59-b87d-32bca6a1699b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.585293 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777455-5de0-4f59-b87d-32bca6a1699b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.605464 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-66777455-5de0-4f59-b87d-32bca6a1699b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:20:02.606692 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-66777455-5de0-4f59-b87d-32bca6a1699b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:20:02.616660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 545/1112] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:20:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:20:02.621375 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a0b1-e470-4e9e-bbd1-e8aa39f4d23d None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:02.632104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3a0b1-e470-4e9e-bbd1-e8aa39f4d23d None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:02.639022 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:02.639747 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.640032 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.640322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.641146 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:20:02.641617 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:02.642682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:02.642682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:20:02.642682 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:20:02.643662 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:02.657181 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 568/1113] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 10:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:20:02.666531 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777455-5de0-4f59-b87d-32bca6a1699b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:02.679515 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777455-5de0-4f59-b87d-32bca6a1699b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:02.686831 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:02.688142 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.688337 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.688641 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.689342 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:02.691169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING py.warnings [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:02.691169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: warnings.warn(msg) May 25 10:20:02.691169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: May 25 10:20:02.692418 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:02.727943 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 546/1114] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 10:20:02 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:20:02.732525 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:02.742794 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243a0e0-86e0-4563-90f0-113c3f15548a admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:02.799734 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:02.800334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.800606 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.800906 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.801619 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:02.802656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:02.802656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:20:02.802656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:20:02.803897 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:02.831654 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 569/1115] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 10:20:02 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:20:02.836036 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:02.847636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241826-c7e5-4423-8821-a54366df00ee admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:02.852816 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:02.853527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.853825 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.854116 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.854890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:02.856005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING py.warnings [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:02.856005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: warnings.warn(msg) May 25 10:20:02.856005 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: May 25 10:20:02.856998 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:02.871210 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 547/1116] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:20:02.876308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:02.891025 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad186c4-092c-4856-9f1d-4aa599cf031d admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:02.897138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca159582-da1d-420b-9a04-a2e539312ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:02.897815 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159582-da1d-420b-9a04-a2e539312ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.898106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159582-da1d-420b-9a04-a2e539312ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.898387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159582-da1d-420b-9a04-a2e539312ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.899124 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca159582-da1d-420b-9a04-a2e539312ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:02.900202 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-ca159582-da1d-420b-9a04-a2e539312ec3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:02.900202 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:20:02.900202 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:20:02.901089 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca159582-da1d-420b-9a04-a2e539312ec3 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:02.915336 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 570/1117] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 10:20:02.921980 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:02.932695 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61e79-4b36-4ed6-b4f8-419ce017a52a admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:02.938931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6c521-61b6-4088-981a-a9d344149b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:02.939872 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c521-61b6-4088-981a-a9d344149b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.940158 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c521-61b6-4088-981a-a9d344149b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.940437 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6c521-61b6-4088-981a-a9d344149b48 admin admin] PATH_INFO: `/v3/projects/100f1367d3604ceeb43b455f33b17d5b/users/5aa3c2504c47466c82459ee8dbbe5407/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:02.956656 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c521-61b6-4088-981a-a9d344149b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100f1367d3604ceeb43b455f33b17d5b, user_id=5aa3c2504c47466c82459ee8dbbe5407, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:02.957706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING py.warnings [None req-25c6c521-61b6-4088-981a-a9d344149b48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:02.957706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: warnings.warn(msg) May 25 10:20:02.957706 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: May 25 10:20:02.959717 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6c521-61b6-4088-981a-a9d344149b48 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:02.975692 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 548/1118] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 10:20:02 2022] PUT /identity/v3/projects/100f1367d3604ceeb43b455f33b17d5b/users/5aa3c2504c47466c82459ee8dbbe5407/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:20:02.987122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662405f-bbad-4251-96c7-93b5b256d171 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:02.987453 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662405f-bbad-4251-96c7-93b5b256d171 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:02.987740 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662405f-bbad-4251-96c7-93b5b256d171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.014858 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-0662405f-bbad-4251-96c7-93b5b256d171 None None] MFA Rules not processed for user `5aa3c2504c47466c82459ee8dbbe5407`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:20:03.016202 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-0662405f-bbad-4251-96c7-93b5b256d171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:20:03.090004 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 571/1119] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:20:02 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:20:03.108595 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d0f87-dab8-4e14-a0e2-ef90b54da5b6 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:03.108914 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d0f87-dab8-4e14-a0e2-ef90b54da5b6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:03.109220 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d0f87-dab8-4e14-a0e2-ef90b54da5b6 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.111229 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 549/1120] 10.222.0.67 () {54 vars in 963 bytes} [Wed May 25 10:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:20:03.116893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84210-cb41-457a-b997-e105b48b60e5 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:03.117187 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84210-cb41-457a-b997-e105b48b60e5 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:03.117469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84210-cb41-457a-b997-e105b48b60e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.138417 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-55c84210-cb41-457a-b997-e105b48b60e5 None None] MFA Rules not processed for user `ccd4c1e5951840048c6e647a88787ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:20:03.139674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-55c84210-cb41-457a-b997-e105b48b60e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:20:03.193932 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:20:03.204791 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 572/1121] 10.222.0.67 () {58 vars in 1060 bytes} [Wed May 25 10:20:03 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:20:03.212711 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d0f87-dab8-4e14-a0e2-ef90b54da5b6 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:03.226008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d0f87-dab8-4e14-a0e2-ef90b54da5b6 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:03.230792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccd4c1e5951840048c6e647a88787ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:03.231696 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:03.232139 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:03.232579 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.243358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:03.245280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:03.256086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 550/1122] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:20:03 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:20:03.294768 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138f38-0b85-4f6c-bdd4-fc8d160d2a0a None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:03.295057 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138f38-0b85-4f6c-bdd4-fc8d160d2a0a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:03.295357 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c138f38-0b85-4f6c-bdd4-fc8d160d2a0a None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.296651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 573/1123] 10.222.0.67 () {52 vars in 829 bytes} [Wed May 25 10:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:20:03.300946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:03.371946 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df651d-4151-4016-8fd1-6d686403f89d service cinder] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:03.377327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:03.378229 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:03.378522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:03.378802 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] PATH_INFO: `/v3/users/5aa3c2504c47466c82459ee8dbbe5407` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.380100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa3c2504c47466c82459ee8dbbe5407)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:03.381177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING py.warnings [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:03.381177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: warnings.warn(msg) May 25 10:20:03.381177 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: May 25 10:20:03.382407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:03.455230 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa3c2504c47466c82459ee8dbbe5407'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:03.468769 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa3c2504c47466c82459ee8dbbe5407'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:03.489635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa3c2504c47466c82459ee8dbbe5407'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:03.490458 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa3c2504c47466c82459ee8dbbe5407'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:03.504166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa3c2504c47466c82459ee8dbbe5407'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:03.515327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 551/1124] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 10:20:03 2022] DELETE /identity/v3/users/5aa3c2504c47466c82459ee8dbbe5407 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:20:03.521467 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:03.521820 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:03.522258 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.544666 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:20:03.545920 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:20:03.613498 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 574/1125] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:20:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:20:03.630212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:03.632606 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:20:03.644318 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:20:03.710924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995f681-62d4-4980-8382-0429577c02b1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:03.715607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545f962-4782-42f2-89d8-8ddfff4f34ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:03.716271 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545f962-4782-42f2-89d8-8ddfff4f34ee service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:03.716607 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545f962-4782-42f2-89d8-8ddfff4f34ee service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:03.716881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545f962-4782-42f2-89d8-8ddfff4f34ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:03.728162 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545f962-4782-42f2-89d8-8ddfff4f34ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:03.729624 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545f962-4782-42f2-89d8-8ddfff4f34ee service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:03.739056 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 552/1126] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:20:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:20:04.091964 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:20:04.093586 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:20:04.107482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101edf99-a1f8-4134-8121-6ab8136a9922 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:20:04.113219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:20:04.114173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:20:04.114603 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:20:04.114714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] PATH_INFO: `/v3/projects/100f1367d3604ceeb43b455f33b17d5b` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:20:04.115933 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100f1367d3604ceeb43b455f33b17d5b)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:20:04.116946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:20:04.116946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:20:04.116946 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:20:04.118155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:20:04.185806 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100f1367d3604ceeb43b455f33b17d5b', 'request_id': 'req-f140b151-843d-4e70-b344-847220982c87'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:04.192246 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100f1367d3604ceeb43b455f33b17d5b', 'request_id': 'req-f140b151-843d-4e70-b344-847220982c87'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:04.206265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100f1367d3604ceeb43b455f33b17d5b', 'request_id': 'req-f140b151-843d-4e70-b344-847220982c87'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:04.225143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] The token cache is being invalidate because project 100f1367d3604ceeb43b455f33b17d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 10:20:04.225475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:04.226251 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-f140b151-843d-4e70-b344-847220982c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:20:04.228145 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 575/1127] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 10:20:04 2022] DELETE /identity/v3/projects/100f1367d3604ceeb43b455f33b17d5b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:20:13.735147 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=25 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:20:14.221367 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:21:31.696054 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17e24-9506-4209-a1f7-36834c07aafa None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:31.696956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17e24-9506-4209-a1f7-36834c07aafa None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:31.696956 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17e24-9506-4209-a1f7-36834c07aafa None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:31.699365 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 553/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:21:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:31.707428 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f23ad-2107-43cf-a2a4-58f404d7cfd0 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:31.708019 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f23ad-2107-43cf-a2a4-58f404d7cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:31.708019 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f23ad-2107-43cf-a2a4-58f404d7cfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:31.784648 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-e35f23ad-2107-43cf-a2a4-58f404d7cfd0 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:31.786322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e35f23ad-2107-43cf-a2a4-58f404d7cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:31.907554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 576/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:21:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:32.095974 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17e24-9506-4209-a1f7-36834c07aafa None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:32.098100 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-8ca17e24-9506-4209-a1f7-36834c07aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:32.193444 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17e24-9506-4209-a1f7-36834c07aafa None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:32.199227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab887e-7001-453b-b960-6d60f74f3a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:32.199916 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab887e-7001-453b-b960-6d60f74f3a47 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:32.200197 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab887e-7001-453b-b960-6d60f74f3a47 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:32.200470 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab887e-7001-453b-b960-6d60f74f3a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:32.208890 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab887e-7001-453b-b960-6d60f74f3a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:32.210520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab887e-7001-453b-b960-6d60f74f3a47 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:32.220901 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 554/1130] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:21:33.132219 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766116e7-a8f8-4ad9-ac1f-dcf50de9368a None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:33.133051 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766116e7-a8f8-4ad9-ac1f-dcf50de9368a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:33.133051 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766116e7-a8f8-4ad9-ac1f-dcf50de9368a None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:33.134938 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 577/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:21:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:33.142962 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c493d9-6f37-4386-91d1-c64e6a903b43 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:33.143458 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c493d9-6f37-4386-91d1-c64e6a903b43 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:33.143575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c493d9-6f37-4386-91d1-c64e6a903b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:33.170899 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-18c493d9-6f37-4386-91d1-c64e6a903b43 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:33.172154 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-18c493d9-6f37-4386-91d1-c64e6a903b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:33.181927 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 555/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:21:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:33.340132 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766116e7-a8f8-4ad9-ac1f-dcf50de9368a None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:33.362734 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766116e7-a8f8-4ad9-ac1f-dcf50de9368a None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:33.368350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde857c1-b5a9-454f-ad76-7dfcffec714f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:33.369028 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde857c1-b5a9-454f-ad76-7dfcffec714f service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:33.369308 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde857c1-b5a9-454f-ad76-7dfcffec714f service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:33.369576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde857c1-b5a9-454f-ad76-7dfcffec714f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:33.378567 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde857c1-b5a9-454f-ad76-7dfcffec714f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:33.380227 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde857c1-b5a9-454f-ad76-7dfcffec714f service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:33.390479 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 578/1133] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:21:37.381777 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48110322-02cb-4ebc-983a-edb9f9b4aded None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:37.382344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48110322-02cb-4ebc-983a-edb9f9b4aded None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:37.382344 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48110322-02cb-4ebc-983a-edb9f9b4aded None None] PATH_INFO: `/v3` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:37.384441 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 556/1134] 10.222.0.13 () {54 vars in 925 bytes} [Wed May 25 10:21:37 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 10:21:37.402436 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8593-93c3-48c5-a918-b3ba0012fe13 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:37.402885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8593-93c3-48c5-a918-b3ba0012fe13 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:37.402992 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad8593-93c3-48c5-a918-b3ba0012fe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:37.433736 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-d2ad8593-93c3-48c5-a918-b3ba0012fe13 None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:37.434967 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-d2ad8593-93c3-48c5-a918-b3ba0012fe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:37.493817 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:21:37.504710 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 579/1135] 10.222.0.13 () {58 vars in 1015 bytes} [Wed May 25 10:21:37 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:41.890241 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28114036-7f14-47de-a9a1-5a52fa310c42 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:41.890815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28114036-7f14-47de-a9a1-5a52fa310c42 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:41.890815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28114036-7f14-47de-a9a1-5a52fa310c42 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:41.892221 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 557/1136] 10.222.0.67 () {54 vars in 960 bytes} [Wed May 25 10:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:41.898324 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f9f88-c878-47c4-907a-b8617629fae1 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:41.898803 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f9f88-c878-47c4-907a-b8617629fae1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:41.898914 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f9f88-c878-47c4-907a-b8617629fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:41.923201 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-759f9f88-c878-47c4-907a-b8617629fae1 None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:41.924443 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-759f9f88-c878-47c4-907a-b8617629fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:41.935128 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 580/1137] 10.222.0.67 () {58 vars in 1057 bytes} [Wed May 25 10:21:41 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:41.943306 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28114036-7f14-47de-a9a1-5a52fa310c42 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:41.960055 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28114036-7f14-47de-a9a1-5a52fa310c42 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:41.966900 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485c903-ff1c-4fda-9b53-67322b1ace5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:41.967599 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c903-ff1c-4fda-9b53-67322b1ace5b service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:41.967889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c903-ff1c-4fda-9b53-67322b1ace5b service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:41.968172 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485c903-ff1c-4fda-9b53-67322b1ace5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:41.977447 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485c903-ff1c-4fda-9b53-67322b1ace5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:41.979075 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485c903-ff1c-4fda-9b53-67322b1ace5b service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:41.989069 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 558/1138] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:41 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:21:44.711134 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58160d3e-570a-45e7-9ba5-67375c45b035 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:44.712129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58160d3e-570a-45e7-9ba5-67375c45b035 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:44.712129 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58160d3e-570a-45e7-9ba5-67375c45b035 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:44.714329 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 581/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:21:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:44.722175 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52afc6-2b47-4d2f-8e85-f001fe4b6c97 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:44.722618 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52afc6-2b47-4d2f-8e85-f001fe4b6c97 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:44.722752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e52afc6-2b47-4d2f-8e85-f001fe4b6c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:44.750322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5e52afc6-2b47-4d2f-8e85-f001fe4b6c97 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:44.751590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5e52afc6-2b47-4d2f-8e85-f001fe4b6c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:44.761034 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 559/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:21:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:44.917552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58160d3e-570a-45e7-9ba5-67375c45b035 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:44.941113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58160d3e-570a-45e7-9ba5-67375c45b035 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:44.948589 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dab6bc-02c9-4d34-a89f-40d631508c2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:44.949232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab6bc-02c9-4d34-a89f-40d631508c2d service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:44.949511 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab6bc-02c9-4d34-a89f-40d631508c2d service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:44.949778 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dab6bc-02c9-4d34-a89f-40d631508c2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:44.958486 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dab6bc-02c9-4d34-a89f-40d631508c2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:44.960099 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dab6bc-02c9-4d34-a89f-40d631508c2d service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:44.969880 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 582/1141] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:21:45.847445 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87c6b-db2f-49e5-8f04-655c54ef7c43 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:45.847931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87c6b-db2f-49e5-8f04-655c54ef7c43 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:45.848030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a87c6b-db2f-49e5-8f04-655c54ef7c43 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:45.849397 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 560/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 10:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:21:45.857304 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fbc3-b81c-4d01-8a8b-05293a2b90da None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:45.857945 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fbc3-b81c-4d01-8a8b-05293a2b90da None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:45.858346 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fbc3-b81c-4d01-8a8b-05293a2b90da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:45.885957 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-0f49fbc3-b81c-4d01-8a8b-05293a2b90da None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:45.887171 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-0f49fbc3-b81c-4d01-8a8b-05293a2b90da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:45.896085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 583/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 10:21:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:46.058857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87c6b-db2f-49e5-8f04-655c54ef7c43 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:46.075932 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a87c6b-db2f-49e5-8f04-655c54ef7c43 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:46.085535 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b49274-a73e-405d-9754-abd5ed39b983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:46.086187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b49274-a73e-405d-9754-abd5ed39b983 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:46.086473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b49274-a73e-405d-9754-abd5ed39b983 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:46.086755 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b49274-a73e-405d-9754-abd5ed39b983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:46.096053 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b49274-a73e-405d-9754-abd5ed39b983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:46.097744 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b49274-a73e-405d-9754-abd5ed39b983 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:46.108248 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 561/1144] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:21:50.344126 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346c36-8d6c-43c7-a89e-373a59d28bb7 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:50.344766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346c36-8d6c-43c7-a89e-373a59d28bb7 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:50.344766 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346c36-8d6c-43c7-a89e-373a59d28bb7 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:50.346043 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 584/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:50.352244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e698-c350-499c-b2d2-e43bcb562f02 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:50.352671 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e698-c350-499c-b2d2-e43bcb562f02 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:50.352812 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2e698-c350-499c-b2d2-e43bcb562f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:50.373532 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b5c2e698-c350-499c-b2d2-e43bcb562f02 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:50.374751 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b5c2e698-c350-499c-b2d2-e43bcb562f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:50.384272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 562/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:21:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:50.424837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346c36-8d6c-43c7-a89e-373a59d28bb7 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:50.428013 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-eb346c36-8d6c-43c7-a89e-373a59d28bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:50.518143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346c36-8d6c-43c7-a89e-373a59d28bb7 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:50.524497 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb622699-3f8e-4241-9bec-efdfa12044b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:50.525185 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb622699-3f8e-4241-9bec-efdfa12044b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:50.525472 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb622699-3f8e-4241-9bec-efdfa12044b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:50.525749 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb622699-3f8e-4241-9bec-efdfa12044b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:50.535618 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb622699-3f8e-4241-9bec-efdfa12044b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:50.537085 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb622699-3f8e-4241-9bec-efdfa12044b2 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:50.546889 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 585/1147] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:21:52.805644 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb9ab4-d1c1-4317-90da-c0a871bed5c8 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:52.806317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb9ab4-d1c1-4317-90da-c0a871bed5c8 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:52.806317 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb9ab4-d1c1-4317-90da-c0a871bed5c8 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:52.807663 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 563/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:52.813492 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a555-4c50-42fc-83ff-643eacbcff0b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:52.813936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a555-4c50-42fc-83ff-643eacbcff0b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:52.814154 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04a555-4c50-42fc-83ff-643eacbcff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:52.838798 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5f04a555-4c50-42fc-83ff-643eacbcff0b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:52.840049 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5f04a555-4c50-42fc-83ff-643eacbcff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:52.848493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 586/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:21:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:52.888357 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb9ab4-d1c1-4317-90da-c0a871bed5c8 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:52.890139 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-c2cb9ab4-d1c1-4317-90da-c0a871bed5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:52.905989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb9ab4-d1c1-4317-90da-c0a871bed5c8 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:52.910143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88ea08-fc02-451f-9cb9-a8909bd0959d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:52.910838 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88ea08-fc02-451f-9cb9-a8909bd0959d service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:52.911096 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88ea08-fc02-451f-9cb9-a8909bd0959d service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:52.911453 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88ea08-fc02-451f-9cb9-a8909bd0959d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:52.921614 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88ea08-fc02-451f-9cb9-a8909bd0959d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:52.923066 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88ea08-fc02-451f-9cb9-a8909bd0959d service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:52.933407 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 564/1150] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:21:56.753626 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269913-0af4-47ff-9302-f8d7fe7e8116 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:56.754245 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269913-0af4-47ff-9302-f8d7fe7e8116 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:56.754245 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269913-0af4-47ff-9302-f8d7fe7e8116 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:56.755587 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 587/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:56.762008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d80db-36dd-4fb0-84c9-1c83aa307ec6 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:56.762784 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d80db-36dd-4fb0-84c9-1c83aa307ec6 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:56.762951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d80db-36dd-4fb0-84c9-1c83aa307ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:56.780250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=67 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:21:56.797794 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-418d80db-36dd-4fb0-84c9-1c83aa307ec6 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:56.799019 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-418d80db-36dd-4fb0-84c9-1c83aa307ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:56.808432 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 565/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:21:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:57.094274 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70269913-0af4-47ff-9302-f8d7fe7e8116 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:57.097651 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-70269913-0af4-47ff-9302-f8d7fe7e8116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:57.189226 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70269913-0af4-47ff-9302-f8d7fe7e8116 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:57.193432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bbc8d-0ad3-4d1d-8002-ce665dad9dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccd4c1e5951840048c6e647a88787ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:57.194089 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bbc8d-0ad3-4d1d-8002-ce665dad9dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:57.194369 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bbc8d-0ad3-4d1d-8002-ce665dad9dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:57.194645 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bbc8d-0ad3-4d1d-8002-ce665dad9dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:57.204872 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bbc8d-0ad3-4d1d-8002-ce665dad9dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:57.206330 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bbc8d-0ad3-4d1d-8002-ce665dad9dd3 service cinder] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:57.216112 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 588/1153] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:21:59.488103 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f8a17-a4b4-4f27-aed2-d1ed1484a807 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:59.488731 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f8a17-a4b4-4f27-aed2-d1ed1484a807 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:59.488731 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f8a17-a4b4-4f27-aed2-d1ed1484a807 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:59.490086 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 566/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 10:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:21:59.497213 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a73ea-d327-449d-98c8-dc35f1968171 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:59.497718 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a73ea-d327-449d-98c8-dc35f1968171 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:59.497924 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a73ea-d327-449d-98c8-dc35f1968171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:59.523750 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-225a73ea-d327-449d-98c8-dc35f1968171 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:21:59.524993 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-225a73ea-d327-449d-98c8-dc35f1968171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:59.533997 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 589/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 10:21:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:21:59.808840 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f8a17-a4b4-4f27-aed2-d1ed1484a807 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:21:59.812507 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-765f8a17-a4b4-4f27-aed2-d1ed1484a807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:21:59.830844 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f8a17-a4b4-4f27-aed2-d1ed1484a807 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:21:59.834992 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836ecb-2e6e-4385-948d-6a06664f91aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccd4c1e5951840048c6e647a88787ff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:21:59.835681 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836ecb-2e6e-4385-948d-6a06664f91aa service cinder] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:21:59.835969 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836ecb-2e6e-4385-948d-6a06664f91aa service cinder] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:21:59.836250 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836ecb-2e6e-4385-948d-6a06664f91aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:21:59.845805 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32836ecb-2e6e-4385-948d-6a06664f91aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:21:59.847296 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32836ecb-2e6e-4385-948d-6a06664f91aa service cinder] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:21:59.857077 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 567/1156] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:21:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:22:09.517734 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=80 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:22:09.852924 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=8 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:21.180511 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ec3a6-1528-4907-9306-5611ea0b0cda None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.181155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ec3a6-1528-4907-9306-5611ea0b0cda None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.181155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ec3a6-1528-4907-9306-5611ea0b0cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.190253 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3542-9866-46bb-804a-004059a0734f None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.190798 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3542-9866-46bb-804a-004059a0734f None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.190798 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3542-9866-46bb-804a-004059a0734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.202462 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-842ec3a6-1528-4907-9306-5611ea0b0cda None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:21.203743 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-842ec3a6-1528-4907-9306-5611ea0b0cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:21.210058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-b5ba3542-9866-46bb-804a-004059a0734f None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:21.211228 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b5ba3542-9866-46bb-804a-004059a0734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:21.212355 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 590/1157] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:21.220715 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 568/1158] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:21.221714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1d8c-5a49-4f6d-ac6b-6a87d8242e08 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.222007 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1d8c-5a49-4f6d-ac6b-6a87d8242e08 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.222305 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea1d8c-5a49-4f6d-ac6b-6a87d8242e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.229633 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6aadc-dc06-4b11-8e2d-beeecead1cd3 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.229920 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6aadc-dc06-4b11-8e2d-beeecead1cd3 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.230222 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6aadc-dc06-4b11-8e2d-beeecead1cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.241761 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-84ea1d8c-5a49-4f6d-ac6b-6a87d8242e08 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:21.242979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-84ea1d8c-5a49-4f6d-ac6b-6a87d8242e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:21.247814 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dbf6aadc-dc06-4b11-8e2d-beeecead1cd3 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:21.249019 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dbf6aadc-dc06-4b11-8e2d-beeecead1cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:21.251882 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 591/1159] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:21.256539 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1d8c-5a49-4f6d-ac6b-6a87d8242e08 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.257008 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 569/1160] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:23:21.261372 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6aadc-dc06-4b11-8e2d-beeecead1cd3 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.265947 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea1d8c-5a49-4f6d-ac6b-6a87d8242e08 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.270292 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6aadc-dc06-4b11-8e2d-beeecead1cd3 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.270644 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.271342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.271660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.271904 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] PATH_INFO: `/v3/domains` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.272638 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:23:21.272948 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.274593 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.274781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.275466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.275748 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.276031 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] PATH_INFO: `/v3/domains` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.276761 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87019) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 10:23:21.277068 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.278074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING py.warnings [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 10:23:21.278074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: warnings.warn(msg) May 25 10:23:21.278074 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: May 25 10:23:21.278935 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.290858 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 592/1161] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:23:21.291030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 570/1162] 10.222.0.67 () {58 vars in 1152 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 10:23:21.295903 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.299016 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.306629 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe90b9-940e-441b-af70-59143c9592eb admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.310321 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c34e5-77ba-473e-be67-6252488957dc admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.313327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.314250 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.314612 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.314970 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.315907 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.316522 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.316949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:23:21.316949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:23:21.316949 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:23:21.317224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.317449 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.317725 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.318178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.318414 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.320385 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.355557 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 593/1163] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:23:21.360196 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.361782 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 571/1164] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:23:21.365590 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.423863 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cd912-9590-4083-b3e7-b5cf94d980fa admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.428577 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.428774 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f368-38ad-43dc-981b-df43e0c26310 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.429482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.429773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.430051 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.430811 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.432733 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.433546 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.434225 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.434509 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.434786 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.435845 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.437571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING py.warnings [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:23:21.437571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: warnings.warn(msg) May 25 10:23:21.437571 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: May 25 10:23:21.438777 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.455313 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 594/1165] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:23:21.459053 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.465640 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 572/1166] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:23:21.466494 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.469257 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226802d-0ebb-4af9-9e07-ba2385dfa264 admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.474892 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.475578 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.475860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.476135 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.476597 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e633c77-9325-465e-b97d-ba8f519208b5 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.476851 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.478466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.481235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.481912 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.482200 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.482473 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.483425 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.485384 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.488734 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 595/1167] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 10:23:21.492742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.495782 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 573/1168] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 10:23:21.500537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.505068 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00586-e560-4618-a8a6-cd9519fe1f47 admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.510534 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.511207 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.511538 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.511825 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.512070 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e2655-fc68-47f3-b4f4-583c6535ab30 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.512576 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.514191 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.518338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.519016 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.519320 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.519606 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.520338 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.522031 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.527860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 596/1169] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 10:23:21.530469 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.533652 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 574/1170] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:23:21.537790 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.541122 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293acf22-407d-4490-b0e4-74385f699339 admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.546060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18504acc-b24f-4ac6-911e-6f106443a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.547113 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504acc-b24f-4ac6-911e-6f106443a434 admin admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.547429 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504acc-b24f-4ac6-911e-6f106443a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.547719 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504acc-b24f-4ac6-911e-6f106443a434 admin admin] PATH_INFO: `/v3/projects/c58267e480234e6a8d2f3263ba1a6aea/users/b4ff13c1077f4ba295c06ba4da27de9e/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.547991 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5ce2a-3f97-4256-8cd8-1d5dffe230d3 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.553635 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e085d9-c779-4bf6-9d37-3e34e1d037e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.554693 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e085d9-c779-4bf6-9d37-3e34e1d037e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.555031 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e085d9-c779-4bf6-9d37-3e34e1d037e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.555316 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e085d9-c779-4bf6-9d37-3e34e1d037e0 admin admin] PATH_INFO: `/v3/projects/8bf5ce61219b436a90ac30bb216f7180/users/15a6effc7722496392a8915a4b88bfe3/roles/8b6c1d1fbb554fcab560889bed4612cc` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.564463 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18504acc-b24f-4ac6-911e-6f106443a434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58267e480234e6a8d2f3263ba1a6aea, user_id=b4ff13c1077f4ba295c06ba4da27de9e, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.565963 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-18504acc-b24f-4ac6-911e-6f106443a434 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:23:21.565963 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:23:21.565963 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:23:21.567986 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18504acc-b24f-4ac6-911e-6f106443a434 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.572131 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e085d9-c779-4bf6-9d37-3e34e1d037e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf5ce61219b436a90ac30bb216f7180, user_id=15a6effc7722496392a8915a4b88bfe3, role_id=8b6c1d1fbb554fcab560889bed4612cc)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.574809 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e085d9-c779-4bf6-9d37-3e34e1d037e0 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.584783 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 597/1171] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 10:23:21 2022] PUT /identity/v3/projects/c58267e480234e6a8d2f3263ba1a6aea/users/b4ff13c1077f4ba295c06ba4da27de9e/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:23:21.590539 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b9d28-ba5c-46e4-8ae3-59d41592f79b None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.590831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b9d28-ba5c-46e4-8ae3-59d41592f79b None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.591110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b9d28-ba5c-46e4-8ae3-59d41592f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.591258 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 575/1172] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 10:23:21 2022] PUT /identity/v3/projects/8bf5ce61219b436a90ac30bb216f7180/users/15a6effc7722496392a8915a4b88bfe3/roles/8b6c1d1fbb554fcab560889bed4612cc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:23:21.597110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67415b-01e4-43d2-abc2-65e614958028 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.597438 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67415b-01e4-43d2-abc2-65e614958028 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.597698 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67415b-01e4-43d2-abc2-65e614958028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.610439 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-604b9d28-ba5c-46e4-8ae3-59d41592f79b None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:21.611706 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-604b9d28-ba5c-46e4-8ae3-59d41592f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:21.623020 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-0f67415b-01e4-43d2-abc2-65e614958028 None None] MFA Rules not processed for user `f728f0a5a3434bf7868adf527331fd5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:21.624356 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0f67415b-01e4-43d2-abc2-65e614958028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:21.653782 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:21.669048 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:21.674248 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 598/1173] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:23:21.684449 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b9d28-ba5c-46e4-8ae3-59d41592f79b None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.692574 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 576/1174] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:21.701800 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67415b-01e4-43d2-abc2-65e614958028 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:21.749333 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b9d28-ba5c-46e4-8ae3-59d41592f79b None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.753016 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2615a6-7898-4f2b-b645-f277d9845e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.753692 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2615a6-7898-4f2b-b645-f277d9845e5b service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.753969 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2615a6-7898-4f2b-b645-f277d9845e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.754247 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2615a6-7898-4f2b-b645-f277d9845e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.756033 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67415b-01e4-43d2-abc2-65e614958028 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:21.759830 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43cf5d-3658-431c-b25d-bcdce4212a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:21.760481 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43cf5d-3658-431c-b25d-bcdce4212a16 service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:21.760765 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43cf5d-3658-431c-b25d-bcdce4212a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:21.761041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43cf5d-3658-431c-b25d-bcdce4212a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:21.763579 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2615a6-7898-4f2b-b645-f277d9845e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.765019 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2615a6-7898-4f2b-b645-f277d9845e5b service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.771212 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43cf5d-3658-431c-b25d-bcdce4212a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:21.772690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43cf5d-3658-431c-b25d-bcdce4212a16 service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:21.774876 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 599/1175] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:23:21.782547 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 577/1176] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:23:27.645210 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918751-35ad-483e-9297-642419fe25c9 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:27.645760 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918751-35ad-483e-9297-642419fe25c9 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:27.645760 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f918751-35ad-483e-9297-642419fe25c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:27.695352 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-3f918751-35ad-483e-9297-642419fe25c9 None None] MFA Rules not processed for user `b4ff13c1077f4ba295c06ba4da27de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:27.696717 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-3f918751-35ad-483e-9297-642419fe25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:27.724646 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de902608-a451-4dfb-ba21-f7082a838941 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:27.725227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de902608-a451-4dfb-ba21-f7082a838941 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:27.725227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de902608-a451-4dfb-ba21-f7082a838941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:27.756228 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-de902608-a451-4dfb-ba21-f7082a838941 None None] MFA Rules not processed for user `15a6effc7722496392a8915a4b88bfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:27.758152 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-de902608-a451-4dfb-ba21-f7082a838941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:27.785317 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 600/1177] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:27 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:27.789605 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f918751-35ad-483e-9297-642419fe25c9 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:27.810785 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f918751-35ad-483e-9297-642419fe25c9 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:27.815809 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:27.816494 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:27.816772 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:27.817142 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:27.817868 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:27.823755 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:27.841989 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 578/1178] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:27 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:27.848969 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de902608-a451-4dfb-ba21-f7082a838941 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:27.854144 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 601/1179] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 10:23:27 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:23:27.858607 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:27.863463 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de902608-a451-4dfb-ba21-f7082a838941 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:27.937871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:27.942285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ec33-5251-4d23-ba96-4009e14e4a8f admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:27.944093 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:27.945421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:27.945738 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:27.946095 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] PATH_INFO: `/v3/projects` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:27.946843 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:27.949797 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:27.955264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:27.956010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:27.956338 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:27.956658 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] PATH_INFO: `/v3/users` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:27.957368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:27.959727 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:27.986079 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 579/1180] 10.222.0.67 () {60 vars in 1152 bytes} [Wed May 25 10:23:27 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 10:23:27.989518 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 602/1181] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 10:23:27 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:23:27.990280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:27.993170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:27.996311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:28.004700 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd91b6-1342-4d56-8fdf-e25a6b1a862f admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.082656 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.083387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.083841 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.084121 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.085415 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.086762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939f449-0acb-45a4-9774-2ea2a9009621 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.087060 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.092013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.092815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.093537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.093537 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] PATH_INFO: `/v3/users` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.094211 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.096792 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.105387 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 603/1182] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:23:28.110269 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:28.123516 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877cc9c-d0fa-4b04-8553-e82126d7f54c admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.124466 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 580/1183] 10.222.0.67 () {60 vars in 1143 bytes} [Wed May 25 10:23:27 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 10:23:28.128088 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:28.139696 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.139981 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0bde5-ee14-4850-98e0-5e4eab94392d admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.140664 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.140900 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.141186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] PATH_INFO: `/v3/projects/b16fe08fce9844f193262c5f63d7988e/users/c1fe644a05f14a94980e5f108b8f8b6c/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.166254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.167329 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16fe08fce9844f193262c5f63d7988e, user_id=c1fe644a05f14a94980e5f108b8f8b6c, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.168145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.168441 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.168871 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.169742 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.170222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.175912 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.190021 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 604/1184] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 10:23:28 2022] PUT /identity/v3/projects/b16fe08fce9844f193262c5f63d7988e/users/c1fe644a05f14a94980e5f108b8f8b6c/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:23:28.193849 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:28.195966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 581/1185] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 10:23:28.200276 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:28.210975 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e05cf1-94e8-4727-9135-6ad290f546f4 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.278703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5513cc-d047-4d34-9221-19c22f44c52a admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.284106 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.284971 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.285250 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.285528 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.286292 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.288332 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.291468 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.292813 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.293201 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.293434 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] PATH_INFO: `/v3/projects/94ac2bdfd82a47f1ae7e06763f4b24ee/users/c6a5257c52ac4f0ba7fa02519d59b170/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.303446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 605/1186] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 10:23:28.307540 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:28.314280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ac2bdfd82a47f1ae7e06763f4b24ee, user_id=c6a5257c52ac4f0ba7fa02519d59b170, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.317245 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.320137 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec7ae4-8882-4ecf-bfc6-62f61d1bec11 admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.329477 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.330960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.330960 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.331411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] PATH_INFO: `/v3/projects/b16fe08fce9844f193262c5f63d7988e/users/c1fe644a05f14a94980e5f108b8f8b6c/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.333901 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16fe08fce9844f193262c5f63d7988e, user_id=c1fe644a05f14a94980e5f108b8f8b6c, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.338204 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 582/1187] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 10:23:28 2022] PUT /identity/v3/projects/94ac2bdfd82a47f1ae7e06763f4b24ee/users/c6a5257c52ac4f0ba7fa02519d59b170/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:23:28.338334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.339322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:28.350597 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 606/1188] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 10:23:28 2022] PUT /identity/v3/projects/b16fe08fce9844f193262c5f63d7988e/users/c1fe644a05f14a94980e5f108b8f8b6c/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:23:28.505810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90112-7d39-441d-8776-8643902e7c1b admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.525780 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:28.618268 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96937f59-b5b6-4103-b43e-6076b3f91164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.619067 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96937f59-b5b6-4103-b43e-6076b3f91164 admin admin] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.619291 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96937f59-b5b6-4103-b43e-6076b3f91164 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.619611 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96937f59-b5b6-4103-b43e-6076b3f91164 admin admin] PATH_INFO: `/v3/roles` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.620349 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96937f59-b5b6-4103-b43e-6076b3f91164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.622050 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96937f59-b5b6-4103-b43e-6076b3f91164 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.641878 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 583/1189] 10.222.0.67 () {58 vars in 1121 bytes} [Wed May 25 10:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 10:23:28.646612 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:28.666252 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea243f1a-7ef2-449f-bedf-09e5ffaac6a8 admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:28.677371 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:28.678834 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] REQUEST_METHOD: `PUT` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:28.679127 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:28.679444 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] PATH_INFO: `/v3/projects/94ac2bdfd82a47f1ae7e06763f4b24ee/users/c6a5257c52ac4f0ba7fa02519d59b170/roles/079434fe84194c03ae64e10d61e222e6` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:28.681610 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ac2bdfd82a47f1ae7e06763f4b24ee, user_id=c6a5257c52ac4f0ba7fa02519d59b170, role_id=079434fe84194c03ae64e10d61e222e6)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:28.690326 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:28.705228 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 607/1190] 10.222.0.67 () {60 vars in 1482 bytes} [Wed May 25 10:23:28 2022] PUT /identity/v3/projects/94ac2bdfd82a47f1ae7e06763f4b24ee/users/c6a5257c52ac4f0ba7fa02519d59b170/roles/079434fe84194c03ae64e10d61e222e6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:23:35.871751 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8a46f-fa3d-423b-bef3-c08f5d18bdd4 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:35.872358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8a46f-fa3d-423b-bef3-c08f5d18bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:35.872358 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8a46f-fa3d-423b-bef3-c08f5d18bdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:35.910651 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-75d8a46f-fa3d-423b-bef3-c08f5d18bdd4 None None] MFA Rules not processed for user `c1fe644a05f14a94980e5f108b8f8b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:35.912949 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-75d8a46f-fa3d-423b-bef3-c08f5d18bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:36.037883 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 584/1191] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:35 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:36.052790 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:36.054994 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:36.121672 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:36.197231 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4678a1-61d5-4701-9bdd-a0ce146fdadc admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:36.201094 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb9cb2a1c8047a8b6b08d3a9df09a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:36.202028 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:36.202381 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:36.202726 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:36.279302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:36.282120 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:36.327368 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 608/1192] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:36 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:23:36.334403 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c342-003c-4815-8873-d0635a2e0e07 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:36.334698 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c342-003c-4815-8873-d0635a2e0e07 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:36.334986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584c342-003c-4815-8873-d0635a2e0e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:36.388688 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-7584c342-003c-4815-8873-d0635a2e0e07 None None] MFA Rules not processed for user `c6a5257c52ac4f0ba7fa02519d59b170`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:36.390722 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-7584c342-003c-4815-8873-d0635a2e0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:36.547261 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 585/1193] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:36 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:36.556847 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:36.563335 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:36.580622 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6dc194-6484-4b15-810d-f839959e1be5 service glance] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:36.585464 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83f2db-b3e4-4160-ad02-efb5b7799fa4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb9cb2a1c8047a8b6b08d3a9df09a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:36.586279 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83f2db-b3e4-4160-ad02-efb5b7799fa4 service glance] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:36.586669 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83f2db-b3e4-4160-ad02-efb5b7799fa4 service glance] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:36.587050 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83f2db-b3e4-4160-ad02-efb5b7799fa4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:36.682633 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83f2db-b3e4-4160-ad02-efb5b7799fa4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:36.701300 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83f2db-b3e4-4160-ad02-efb5b7799fa4 service glance] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:36.732475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 609/1194] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:36 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:23:45.134366 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ffa71-21d7-46af-832e-2020038f8085 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:45.135000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ffa71-21d7-46af-832e-2020038f8085 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:45.135000 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ffa71-21d7-46af-832e-2020038f8085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:45.156240 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-164ffa71-21d7-46af-832e-2020038f8085 None None] MFA Rules not processed for user `15a6effc7722496392a8915a4b88bfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:45.158058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-164ffa71-21d7-46af-832e-2020038f8085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:45.168582 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 586/1195] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:23:45 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:45.493402 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a736d9-f635-4315-9ae6-5055b36edad2 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:45.494010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a736d9-f635-4315-9ae6-5055b36edad2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:45.494010 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a736d9-f635-4315-9ae6-5055b36edad2 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:45.495552 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 610/1196] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 10:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:23:45.503196 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4531-dda6-4cc4-81b1-3121a8663215 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:45.503789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4531-dda6-4cc4-81b1-3121a8663215 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:45.503789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca4531-dda6-4cc4-81b1-3121a8663215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:45.524786 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=100 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:45.537657 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-5dca4531-dda6-4cc4-81b1-3121a8663215 None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:45.538898 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-5dca4531-dda6-4cc4-81b1-3121a8663215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:45.630329 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 587/1197] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 10:23:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:45.636703 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1475c8-c4bf-4d7f-a5b8-aba27bc4d9b2 None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:45.637008 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1475c8-c4bf-4d7f-a5b8-aba27bc4d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:45.637267 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1475c8-c4bf-4d7f-a5b8-aba27bc4d9b2 None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:45.638684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 611/1198] 10.222.0.67 () {54 vars in 912 bytes} [Wed May 25 10:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:23:45.644861 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd5a79-194b-4759-b853-f24b2139539b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:45.645542 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd5a79-194b-4759-b853-f24b2139539b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:45.645542 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd5a79-194b-4759-b853-f24b2139539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:45.671117 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-38dd5a79-194b-4759-b853-f24b2139539b None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:45.672393 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-38dd5a79-194b-4759-b853-f24b2139539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:45.681912 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 588/1199] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 10:23:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:23:45.695075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1475c8-c4bf-4d7f-a5b8-aba27bc4d9b2 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:45.710885 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1475c8-c4bf-4d7f-a5b8-aba27bc4d9b2 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:45.714511 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f361c-060f-4303-944b-57003b1f03be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edb9cb2a1c8047a8b6b08d3a9df09a36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:45.715170 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f361c-060f-4303-944b-57003b1f03be service glance] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:45.715484 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f361c-060f-4303-944b-57003b1f03be service glance] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:45.715754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f361c-060f-4303-944b-57003b1f03be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:45.727052 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f361c-060f-4303-944b-57003b1f03be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:45.728742 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f361c-060f-4303-944b-57003b1f03be service glance] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:45.741264 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 612/1200] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:23:46.114223 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa1994-982d-49ef-a1de-9918254df5c5 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.115593 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa1994-982d-49ef-a1de-9918254df5c5 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.116010 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa1994-982d-49ef-a1de-9918254df5c5 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.117558 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 589/1201] 10.222.0.67 () {54 vars in 912 bytes} [Wed May 25 10:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:23:46.124411 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054c07-6512-4237-9422-b235293d4401 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.124699 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054c07-6512-4237-9422-b235293d4401 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.124975 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e054c07-6512-4237-9422-b235293d4401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.146141 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-8e054c07-6512-4237-9422-b235293d4401 None None] MFA Rules not processed for user `fa4af93cd76845db97b72cfb27664bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:46.147520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-8e054c07-6512-4237-9422-b235293d4401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:46.221537 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 613/1202] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 10:23:46 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:46.233756 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa1994-982d-49ef-a1de-9918254df5c5 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:46.246906 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa1994-982d-49ef-a1de-9918254df5c5 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:46.251159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ea773-404d-4053-812b-3685882bc40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:46.251857 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea773-404d-4053-812b-3685882bc40f service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.252143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea773-404d-4053-812b-3685882bc40f service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.252416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ea773-404d-4053-812b-3685882bc40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.260133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ea773-404d-4053-812b-3685882bc40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:46.261567 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ea773-404d-4053-812b-3685882bc40f service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:46.270941 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 590/1203] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:46 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:23:46.725965 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970214-43ae-4032-9e86-d2c0a7f4620a None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.726837 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970214-43ae-4032-9e86-d2c0a7f4620a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.727188 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10970214-43ae-4032-9e86-d2c0a7f4620a None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.728776 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 614/1204] 10.222.0.67 () {54 vars in 961 bytes} [Wed May 25 10:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:23:46.737437 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34dbb3-13ac-40d9-8d18-29bc0b91a68c None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.737643 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c41f3-d17c-463d-b3e1-4c0151be11b2 None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.737869 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34dbb3-13ac-40d9-8d18-29bc0b91a68c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.737986 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c41f3-d17c-463d-b3e1-4c0151be11b2 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.738257 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c41f3-d17c-463d-b3e1-4c0151be11b2 None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.738365 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34dbb3-13ac-40d9-8d18-29bc0b91a68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.740148 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 591/1205] 10.222.0.67 () {54 vars in 960 bytes} [Wed May 25 10:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:23:46.745325 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8f48a-15b1-4b8a-a13a-abaafe2f0b3b None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.745818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8f48a-15b1-4b8a-a13a-abaafe2f0b3b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.746101 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8f48a-15b1-4b8a-a13a-abaafe2f0b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.753819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:23:46.760560 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-5d34dbb3-13ac-40d9-8d18-29bc0b91a68c None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:46.762461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-5d34dbb3-13ac-40d9-8d18-29bc0b91a68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:46.772571 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 615/1206] 10.222.0.67 () {58 vars in 1058 bytes} [Wed May 25 10:23:46 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:23:46.777739 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-dba8f48a-15b1-4b8a-a13a-abaafe2f0b3b None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:46.778413 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5460-d750-4f8d-9204-d8efab368d3f None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.778712 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5460-d750-4f8d-9204-d8efab368d3f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.778931 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-dba8f48a-15b1-4b8a-a13a-abaafe2f0b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:46.779056 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a5460-d750-4f8d-9204-d8efab368d3f None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.780741 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 616/1207] 10.222.0.67 () {54 vars in 912 bytes} [Wed May 25 10:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 10:23:46.785923 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54db89e-4820-4866-bbcc-af93adf959b0 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.786423 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54db89e-4820-4866-bbcc-af93adf959b0 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.786898 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54db89e-4820-4866-bbcc-af93adf959b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.812660 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-d54db89e-4820-4866-bbcc-af93adf959b0 None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:46.813871 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-d54db89e-4820-4866-bbcc-af93adf959b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:46.823495 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 617/1208] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 10:23:46 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:23:46.835405 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54db89e-4820-4866-bbcc-af93adf959b0 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:46.845222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54db89e-4820-4866-bbcc-af93adf959b0 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:46.849265 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021b25-4995-4fee-8f34-49a87b249411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:46.849941 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021b25-4995-4fee-8f34-49a87b249411 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.850217 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021b25-4995-4fee-8f34-49a87b249411 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.850493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021b25-4995-4fee-8f34-49a87b249411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.860973 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021b25-4995-4fee-8f34-49a87b249411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:46.862417 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a021b25-4995-4fee-8f34-49a87b249411 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:46.864115 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 592/1209] 10.222.0.67 () {58 vars in 1057 bytes} [Wed May 25 10:23:46 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:46.871414 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8f48a-15b1-4b8a-a13a-abaafe2f0b3b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:46.875802 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 618/1210] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:46 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:23:46.886411 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8f48a-15b1-4b8a-a13a-abaafe2f0b3b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:46.892979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:46.893642 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:46.893976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:46.894311 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:46.896280 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:46.915332 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:46.917002 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:46.929226 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 593/1211] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 10:23:56.764322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2d15-6173-4f87-a2fe-a33c81564ba1 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:56.764853 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2d15-6173-4f87-a2fe-a33c81564ba1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:56.764950 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb2d15-6173-4f87-a2fe-a33c81564ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:56.783407 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-adcb2d15-6173-4f87-a2fe-a33c81564ba1 None None] MFA Rules not processed for user `fa4af93cd76845db97b72cfb27664bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:56.784630 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-adcb2d15-6173-4f87-a2fe-a33c81564ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:56.791542 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 619/1212] 10.222.0.13 () {58 vars in 1015 bytes} [Wed May 25 10:23:56 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:56.803973 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:56.813925 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5e97f-f1e2-4123-8683-cdcfbdf1a770 service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:56.817960 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d5214-66d4-4434-a884-5837d1fb9efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:56.818636 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d5214-66d4-4434-a884-5837d1fb9efb service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:56.818932 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d5214-66d4-4434-a884-5837d1fb9efb service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:56.819214 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d5214-66d4-4434-a884-5837d1fb9efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:56.827322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d5214-66d4-4434-a884-5837d1fb9efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:56.828763 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d5214-66d4-4434-a884-5837d1fb9efb service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:56.837219 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 594/1213] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:56 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:23:57.756917 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936d1a-827e-456c-b2fe-fd7ed29f8d8c None None] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:57.757283 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936d1a-827e-456c-b2fe-fd7ed29f8d8c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:57.757406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936d1a-827e-456c-b2fe-fd7ed29f8d8c None None] PATH_INFO: `/` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:57.758795 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 620/1214] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:23:57.775489 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a11e-6b2d-47a5-a1fd-3c1d97be2169 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:57.775708 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a11e-6b2d-47a5-a1fd-3c1d97be2169 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:57.776415 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34a11e-6b2d-47a5-a1fd-3c1d97be2169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:57.816375 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-fa34a11e-6b2d-47a5-a1fd-3c1d97be2169 None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:23:57.818698 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-fa34a11e-6b2d-47a5-a1fd-3c1d97be2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:23:57.830156 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 595/1215] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:23:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:23:57.870448 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24936d1a-827e-456c-b2fe-fd7ed29f8d8c None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:23:57.902350 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24936d1a-827e-456c-b2fe-fd7ed29f8d8c None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:23:57.913141 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd808e-fd1f-416c-98d1-7e10bd8f8901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:23:57.913810 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd808e-fd1f-416c-98d1-7e10bd8f8901 service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:23:57.914120 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd808e-fd1f-416c-98d1-7e10bd8f8901 service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:23:57.914392 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd808e-fd1f-416c-98d1-7e10bd8f8901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:23:57.933684 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd808e-fd1f-416c-98d1-7e10bd8f8901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:23:57.936091 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd808e-fd1f-416c-98d1-7e10bd8f8901 service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:23:57.947815 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 621/1216] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:23:57 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:24:03.785655 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04556abb-38e5-45ea-b62b-db6352ef6cca None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:03.786915 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04556abb-38e5-45ea-b62b-db6352ef6cca None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:03.787697 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04556abb-38e5-45ea-b62b-db6352ef6cca None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:03.789224 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 596/1217] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:24:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:24:03.795819 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c6f0-d033-4eda-b639-9711ff75bbb1 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:03.796457 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c6f0-d033-4eda-b639-9711ff75bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:03.796457 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c6f0-d033-4eda-b639-9711ff75bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:03.830260 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-0d55c6f0-d033-4eda-b639-9711ff75bbb1 None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:24:03.832285 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-0d55c6f0-d033-4eda-b639-9711ff75bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:24:03.847307 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 622/1218] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:24:03 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:24:03.867328 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04556abb-38e5-45ea-b62b-db6352ef6cca None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:24:03.882426 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04556abb-38e5-45ea-b62b-db6352ef6cca None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:24:03.888386 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2dcae4-189f-436c-ab18-1172fc7cc2f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:24:03.889149 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dcae4-189f-436c-ab18-1172fc7cc2f4 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:03.890180 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dcae4-189f-436c-ab18-1172fc7cc2f4 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:03.890394 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dcae4-189f-436c-ab18-1172fc7cc2f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:03.900479 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2dcae4-189f-436c-ab18-1172fc7cc2f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:24:03.902244 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2dcae4-189f-436c-ab18-1172fc7cc2f4 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:24:03.912461 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 597/1219] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:24:03 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:24:13.815354 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=21 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:24:13.908300 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:24:14.616294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c6f0-d033-4eda-b639-9711ff75bbb1 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:24:14.625865 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c6f0-d033-4eda-b639-9711ff75bbb1 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:24:14.629500 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157d00-abad-4817-b697-1937ff5732bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:24:14.630218 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157d00-abad-4817-b697-1937ff5732bd service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:14.630565 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157d00-abad-4817-b697-1937ff5732bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:14.630936 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157d00-abad-4817-b697-1937ff5732bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:14.640209 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157d00-abad-4817-b697-1937ff5732bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:24:14.641667 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157d00-abad-4817-b697-1937ff5732bd service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:24:14.652312 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 623/1220] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:24:14 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:24:16.748025 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244fb49-2f91-4e18-9c07-abbe9adf0dff None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:16.748641 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244fb49-2f91-4e18-9c07-abbe9adf0dff None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:16.748855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244fb49-2f91-4e18-9c07-abbe9adf0dff None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:16.751171 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 598/1221] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:24:16.758007 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f91f4-ab90-4d46-a1e6-efb19123833a None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:16.758588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f91f4-ab90-4d46-a1e6-efb19123833a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:16.758588 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f91f4-ab90-4d46-a1e6-efb19123833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:16.780348 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-0d7f91f4-ab90-4d46-a1e6-efb19123833a None None] MFA Rules not processed for user `245c6d51f8224624be6289a20874b5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:24:16.781866 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-0d7f91f4-ab90-4d46-a1e6-efb19123833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:24:16.792831 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 624/1222] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:24:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:24:16.811431 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244fb49-2f91-4e18-9c07-abbe9adf0dff None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:24:16.829624 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244fb49-2f91-4e18-9c07-abbe9adf0dff None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:24:16.838159 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08155d7e-1de5-4940-934d-07c5f224d8b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:24:16.839423 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155d7e-1de5-4940-934d-07c5f224d8b5 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:16.839815 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155d7e-1de5-4940-934d-07c5f224d8b5 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:16.840068 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08155d7e-1de5-4940-934d-07c5f224d8b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:16.854581 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155d7e-1de5-4940-934d-07c5f224d8b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:24:16.856455 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08155d7e-1de5-4940-934d-07c5f224d8b5 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:24:16.869953 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 599/1223] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:24:16 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:24:26.773138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=9 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:24:26.863760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=6 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:24:37.538104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbc2e-05f1-45a5-bc3d-be035e90df3f None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:37.538670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbc2e-05f1-45a5-bc3d-be035e90df3f None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:37.538670 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbc2e-05f1-45a5-bc3d-be035e90df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:37.558364 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-b27cbc2e-05f1-45a5-bc3d-be035e90df3f None None] MFA Rules not processed for user `b4ff13c1077f4ba295c06ba4da27de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:24:37.560072 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-b27cbc2e-05f1-45a5-bc3d-be035e90df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:24:37.568110 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 625/1224] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:24:37 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:24:37.902499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878136e-ac8d-4eb5-a570-5d7881fae88a None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:37.903056 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878136e-ac8d-4eb5-a570-5d7881fae88a None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:37.903260 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878136e-ac8d-4eb5-a570-5d7881fae88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:37.922143 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-3878136e-ac8d-4eb5-a570-5d7881fae88a None None] MFA Rules not processed for user `fa4af93cd76845db97b72cfb27664bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:24:37.923385 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-3878136e-ac8d-4eb5-a570-5d7881fae88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:24:37.930649 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 600/1225] 10.222.0.67 () {58 vars in 1009 bytes} [Wed May 25 10:24:37 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:24:37.942408 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbc2e-05f1-45a5-bc3d-be035e90df3f None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:24:37.952968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbc2e-05f1-45a5-bc3d-be035e90df3f None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:24:37.957067 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185915e7-e5e2-41e0-9015-3fad3932547d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:24:37.957714 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185915e7-e5e2-41e0-9015-3fad3932547d service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:24:37.958003 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185915e7-e5e2-41e0-9015-3fad3932547d service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:24:37.958342 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185915e7-e5e2-41e0-9015-3fad3932547d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:24:37.966746 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185915e7-e5e2-41e0-9015-3fad3932547d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:24:37.968232 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185915e7-e5e2-41e0-9015-3fad3932547d service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:24:37.976748 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 626/1226] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:24:37 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:24:47.917122 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:24:47.972870 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=9 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:25:03.109978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d20e8-1741-46ce-861e-f4501b76c0c7 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:03.110460 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d20e8-1741-46ce-861e-f4501b76c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:03.110543 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d20e8-1741-46ce-861e-f4501b76c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:03.129762 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-bd5d20e8-1741-46ce-861e-f4501b76c0c7 None None] MFA Rules not processed for user `b4ff13c1077f4ba295c06ba4da27de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:25:03.130978 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bd5d20e8-1741-46ce-861e-f4501b76c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:25:03.139701 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 601/1227] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:25:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:25:13.124512 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=3 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:25:16.741493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe20a7-08b9-4dc8-9d08-6cd7ca6f750a None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:16.741981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe20a7-08b9-4dc8-9d08-6cd7ca6f750a None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:16.742071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe20a7-08b9-4dc8-9d08-6cd7ca6f750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:16.761459 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-90fe20a7-08b9-4dc8-9d08-6cd7ca6f750a None None] MFA Rules not processed for user `b4ff13c1077f4ba295c06ba4da27de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:25:16.762661 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-90fe20a7-08b9-4dc8-9d08-6cd7ca6f750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:25:16.771071 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 627/1228] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:25:16 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:25:26.755918 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=3 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:25:45.948426 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4dc1-8e30-4de7-8b7f-2d6e5790aa9b None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:45.949369 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4dc1-8e30-4de7-8b7f-2d6e5790aa9b None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:45.949971 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f4dc1-8e30-4de7-8b7f-2d6e5790aa9b None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:45.953169 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 602/1229] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:25:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:25:45.967466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f542-69cf-45c4-ba8f-cdd214f7b875 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:45.968166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f542-69cf-45c4-ba8f-cdd214f7b875 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:45.968166 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653f542-69cf-45c4-ba8f-cdd214f7b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:46.008327 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-d653f542-69cf-45c4-ba8f-cdd214f7b875 None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:25:46.010021 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-d653f542-69cf-45c4-ba8f-cdd214f7b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:25:46.022708 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 628/1230] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:25:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 10:25:46.064061 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f4dc1-8e30-4de7-8b7f-2d6e5790aa9b None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:25:46.082133 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f4dc1-8e30-4de7-8b7f-2d6e5790aa9b None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:25:46.089213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:25:46.089979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:46.090335 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:46.090702 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:46.107660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:25:46.111237 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:25:46.125591 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 603/1231] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:25:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:25:49.838738 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653f542-69cf-45c4-ba8f-cdd214f7b875 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:25:49.918876 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653f542-69cf-45c4-ba8f-cdd214f7b875 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:25:49.924841 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:25:49.925836 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:49.926119 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:49.926394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] PATH_INFO: `/v3/users/15a6effc7722496392a8915a4b88bfe3` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:49.927713 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a6effc7722496392a8915a4b88bfe3)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:25:49.928905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: WARNING py.warnings [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:25:49.928905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: warnings.warn(msg) May 25 10:25:49.928905 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: May 25 10:25:49.930242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:25:50.003754 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a6effc7722496392a8915a4b88bfe3'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.004493 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a6effc7722496392a8915a4b88bfe3'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.014104 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a6effc7722496392a8915a4b88bfe3'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.037349 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a6effc7722496392a8915a4b88bfe3'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.049962 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a6effc7722496392a8915a4b88bfe3'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.057272 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 629/1232] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 10:25:49 2022] DELETE /identity/v3/users/15a6effc7722496392a8915a4b88bfe3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:25:50.261551 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:25:50.281174 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4703ac-c2e1-45a8-b19f-68f86496787e service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:25:50.360472 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:25:50.361322 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:50.361569 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:50.361874 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] PATH_INFO: `/v3/projects/8bf5ce61219b436a90ac30bb216f7180` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:50.363171 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf5ce61219b436a90ac30bb216f7180)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:25:50.364346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: WARNING py.warnings [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 10:25:50.364346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: warnings.warn(msg) May 25 10:25:50.364346 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: May 25 10:25:50.365740 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:25:50.427112 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf5ce61219b436a90ac30bb216f7180', 'request_id': 'req-4f6591bf-67a7-4255-9603-61b38b5c0b14'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.437013 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf5ce61219b436a90ac30bb216f7180', 'request_id': 'req-4f6591bf-67a7-4255-9603-61b38b5c0b14'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.443860 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf5ce61219b436a90ac30bb216f7180', 'request_id': 'req-4f6591bf-67a7-4255-9603-61b38b5c0b14'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.463468 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] The token cache is being invalidate because project 8bf5ce61219b436a90ac30bb216f7180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 10:25:50.463760 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.464520 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.466227 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 604/1233] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 10:25:50 2022] DELETE /identity/v3/projects/8bf5ce61219b436a90ac30bb216f7180 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:25:50.470548 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:25:50.472180 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:25:50.486295 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967611a1-f82d-4319-aef6-732319935105 admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:25:50.549881 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:25:50.562779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:25:50.563719 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:50.564006 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:50.564282 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] PATH_INFO: `/v3/users/c6a5257c52ac4f0ba7fa02519d59b170` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:50.565554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a5257c52ac4f0ba7fa02519d59b170)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:25:50.567543 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:25:50.621737 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a5257c52ac4f0ba7fa02519d59b170'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.622398 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a5257c52ac4f0ba7fa02519d59b170'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.636403 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a5257c52ac4f0ba7fa02519d59b170'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.662120 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a5257c52ac4f0ba7fa02519d59b170'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.672520 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-15606060-29e6-4a9d-a76c-5ce8f3ca73ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a5257c52ac4f0ba7fa02519d59b170'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:50.680366 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 630/1234] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 10:25:50 2022] DELETE /identity/v3/users/c6a5257c52ac4f0ba7fa02519d59b170 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:25:50.877665 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:25:50.879179 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:25:50.893196 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6591bf-67a7-4255-9603-61b38b5c0b14 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:25:50.958278 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:25:50.958889 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:25:50.959391 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:25:50.959552 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] PATH_INFO: `/v3/projects/94ac2bdfd82a47f1ae7e06763f4b24ee` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:25:50.960979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ac2bdfd82a47f1ae7e06763f4b24ee)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:25:50.963046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:25:50.989298 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:25:51.025660 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ac2bdfd82a47f1ae7e06763f4b24ee', 'request_id': 'req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:51.034854 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ac2bdfd82a47f1ae7e06763f4b24ee', 'request_id': 'req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:51.040856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ac2bdfd82a47f1ae7e06763f4b24ee', 'request_id': 'req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:51.052124 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] The token cache is being invalidate because project 94ac2bdfd82a47f1ae7e06763f4b24ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87019) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 10:25:51.052416 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:51.053058 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:25:51.054670 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 605/1235] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 10:25:50 2022] DELETE /identity/v3/projects/94ac2bdfd82a47f1ae7e06763f4b24ee => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 10:26:00.676063 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:26:01.049152 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:26:17.339475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:26:17.340087 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:26:17.340087 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:26:17.360294 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] MFA Rules not processed for user `b4ff13c1077f4ba295c06ba4da27de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:26:17.361547 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:26:17.423082 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 631/1236] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:26:17 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:26:27.415529 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=25 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:26:29.039053 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:26:29.040689 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:26:29.112812 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce05ca4-6a83-4caf-b659-6b4fca3c098f admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:26:29.116621 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:26:29.117272 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:26:29.118231 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:26:29.118512 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:26:29.120412 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:26:29.184688 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:26:29.186171 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:26:29.196716 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 606/1237] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:26:29 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:26:39.192145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=54 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:26:41.608839 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:26:41.610466 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:26:41.693428 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bbb99-9d59-4269-a006-6467031ae136 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:26:41.699302 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:26:41.700047 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:26:41.700599 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:26:41.700711 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:26:41.702779 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:26:41.715075 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:26:41.717674 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:26:41.733452 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 632/1238] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:26:41 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:26:51.728432 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=36 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:28:46.008782 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:28:46.010501 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:46.093506 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6043-1590-4b6d-a085-da4b38c314ba service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:28:46.099423 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:28:46.100082 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:28:46.100365 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:28:46.100642 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:28:46.102913 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:46.114158 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:28:46.115803 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:28:46.125187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 607/1239] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:28:46 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:28:46.312425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:28:46.323225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa762e9-1691-4627-a14c-9402940e599d service placement] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:28:46.327246 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912bd83-f6b4-4658-ac15-fc8a737c96ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:28:46.327937 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912bd83-f6b4-4658-ac15-fc8a737c96ed service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:28:46.328223 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912bd83-f6b4-4658-ac15-fc8a737c96ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:28:46.328505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912bd83-f6b4-4658-ac15-fc8a737c96ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:28:46.330665 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-a912bd83-f6b4-4658-ac15-fc8a737c96ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:46.345202 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912bd83-f6b4-4658-ac15-fc8a737c96ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:28:46.346675 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912bd83-f6b4-4658-ac15-fc8a737c96ed service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:28:46.357769 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 633/1240] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:28:46 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:28:47.538566 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:28:47.548789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b0124-809f-4d12-a483-90d54322f0a8 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:28:47.552575 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:28:47.553235 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:28:47.553514 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:28:47.553789 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:28:47.555881 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:47.569240 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:28:47.571958 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:28:47.583602 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 608/1241] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:28:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:28:49.873482 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:28:49.874009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:28:49.874009 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:28:49.893255 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] MFA Rules not processed for user `b4ff13c1077f4ba295c06ba4da27de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:28:49.894483 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:49.902893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 634/1242] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:28:49 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:28:50.695769 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:28:50.708046 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71efa9-36da-4d09-b903-6d03e20a3b4d service neutron] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:28:50.713868 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deda92-7199-4ccf-b8ed-8cf3c57cfde0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:28:50.714752 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deda92-7199-4ccf-b8ed-8cf3c57cfde0 service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:28:50.715043 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deda92-7199-4ccf-b8ed-8cf3c57cfde0 service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:28:50.715361 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deda92-7199-4ccf-b8ed-8cf3c57cfde0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:28:50.717301 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f9deda92-7199-4ccf-b8ed-8cf3c57cfde0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:50.730637 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deda92-7199-4ccf-b8ed-8cf3c57cfde0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:28:50.732284 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9deda92-7199-4ccf-b8ed-8cf3c57cfde0 service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:28:50.743734 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 609/1243] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:28:50 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:28:59.030173 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:28:59.031883 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:59.045567 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201cae5-05e6-4ac9-a009-705278620c7c None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:28:59.050288 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:28:59.050948 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:28:59.051234 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:28:59.051536 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:28:59.053659 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:28:59.065650 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:28:59.067115 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:28:59.077448 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 635/1244] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:28:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:29:00.738629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=48 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:29:09.072561 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=15 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:30:59.277518 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930edb-442d-4e1c-bac5-818dd008f843 None None] REQUEST_METHOD: `POST` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:30:59.278080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930edb-442d-4e1c-bac5-818dd008f843 None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:30:59.278080 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4930edb-442d-4e1c-bac5-818dd008f843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:30:59.297021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.auth.core [None req-f4930edb-442d-4e1c-bac5-818dd008f843 None None] MFA Rules not processed for user `b4ff13c1077f4ba295c06ba4da27de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87019) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:30:59.298254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-f4930edb-442d-4e1c-bac5-818dd008f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:30:59.307562 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 610/1245] 10.222.0.67 () {58 vars in 957 bytes} [Wed May 25 10:30:59 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:30:59.646316 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:30:59.655425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16821b0-55a3-4fac-ab68-d241ebd6f195 service neutron] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:30:59.660133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:30:59.660783 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:30:59.661042 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:30:59.661304 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:30:59.663225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:30:59.672920 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:30:59.674461 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:30:59.683172 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 636/1246] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:30:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:31:03.597727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930edb-442d-4e1c-bac5-818dd008f843 None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:31:03.611606 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4930edb-442d-4e1c-bac5-818dd008f843 None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:31:03.617601 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:31:03.618327 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:31:03.618612 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:31:03.618878 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:31:03.621039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:31:03.635499 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:31:03.637183 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:31:03.667426 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 611/1247] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:31:03 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:31:09.679394 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=6 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:31:11.416801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:31:11.418812 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:31:11.437893 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efa95-3ced-4387-8864-94a168e27ad3 service neutron] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:31:11.443963 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:31:11.444671 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:31:11.444953 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:31:11.445242 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:31:11.447341 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:31:11.461236 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:31:11.462870 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:31:11.473716 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 637/1248] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:31:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:31:13.656302 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=9 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:31:21.469141 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=6 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:31:50.591512 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:31:50.635289 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dea72-f1a5-48ab-af30-6092c344f491 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:31:50.642625 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:31:50.643547 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:31:50.643844 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:31:50.644254 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:31:50.654510 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:31:50.656145 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:31:50.665855 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 612/1249] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:31:50 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:32:00.661976 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=20 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:33:44.661804 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:44.715155 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda55f-6179-4aba-87e6-c74c6c9c9f45 service nova] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:44.721178 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:44.721860 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:44.722143 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:44.722421 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:44.724553 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:44.765397 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:44.767267 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:44.779557 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 638/1250] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:33:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:33:45.999850 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:46.012417 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1eebf5-95f3-4b08-bdd2-7beac30bb400 service placement] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:46.018704 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '245c6d51f8224624be6289a20874b5b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:46.019420 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:46.019690 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:46.019958 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:46.029746 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:46.031440 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:46.060530 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 613/1251] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:33:45 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:33:47.284244 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:47.294847 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98771c-7c4e-4591-b841-42b30a02f3a3 service nova] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:47.299550 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:47.300446 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:47.300773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:47.301079 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:47.313322 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:47.314996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:47.326240 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 639/1252] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:33:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:33:50.313491 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:50.323966 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9bd1f-f0e4-435f-9ee6-3677075766d0 service nova] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:50.328077 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb463a-2444-4eb6-8ff2-6e4a16364a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa4af93cd76845db97b72cfb27664bd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:50.328745 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb463a-2444-4eb6-8ff2-6e4a16364a3b service neutron] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:50.329022 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb463a-2444-4eb6-8ff2-6e4a16364a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:50.329305 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb463a-2444-4eb6-8ff2-6e4a16364a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:50.331187 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-2efb463a-2444-4eb6-8ff2-6e4a16364a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:50.417318 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb463a-2444-4eb6-8ff2-6e4a16364a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:50.418781 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb463a-2444-4eb6-8ff2-6e4a16364a3b service neutron] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:50.428684 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 614/1253] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:33:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:33:53.800770 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:53.802968 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:53.840161 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550a469-9b8f-48c9-bb8b-9ebb7688eba7 service neutron] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:53.845883 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca074209-c9f0-4990-be18-934b4618d92d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:53.846584 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074209-c9f0-4990-be18-934b4618d92d service placement] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:53.846879 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074209-c9f0-4990-be18-934b4618d92d service placement] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:53.847141 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca074209-c9f0-4990-be18-934b4618d92d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:53.849172 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-ca074209-c9f0-4990-be18-934b4618d92d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:53.864214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca074209-c9f0-4990-be18-934b4618d92d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:53.864214 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca074209-c9f0-4990-be18-934b4618d92d service placement] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:53.874999 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 640/1254] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:33:53 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:33:56.864287 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673f7d-305c-4863-9a2c-f8b1e86c636d None None] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:56.864727 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673f7d-305c-4863-9a2c-f8b1e86c636d None None] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:56.864818 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673f7d-305c-4863-9a2c-f8b1e86c636d None None] PATH_INFO: `/` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:56.866588 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 615/1255] 10.222.0.67 () {54 vars in 921 bytes} [Wed May 25 10:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 10:33:56.875857 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08ca9-25f8-4bdc-8868-96cda312eed3 None None] REQUEST_METHOD: `POST` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:56.876773 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08ca9-25f8-4bdc-8868-96cda312eed3 None None] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:56.877221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc08ca9-25f8-4bdc-8868-96cda312eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:56.940186 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.auth.core [None req-6fc08ca9-25f8-4bdc-8868-96cda312eed3 None None] MFA Rules not processed for user `1c4c0e33447e4a70be3de0256513ef51`. Rule list: `[]` (Enabled: `True`). {{(pid=87020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 10:33:56.941756 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-6fc08ca9-25f8-4bdc-8868-96cda312eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:56.951820 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 641/1256] 10.222.0.67 () {58 vars in 1018 bytes} [Wed May 25 10:33:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 10:33:56.957616 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673f7d-305c-4863-9a2c-f8b1e86c636d None None] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:56.959436 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-9c673f7d-305c-4863-9a2c-f8b1e86c636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:56.967594 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08ca9-25f8-4bdc-8868-96cda312eed3 None None] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:56.977866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673f7d-305c-4863-9a2c-f8b1e86c636d None None] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:56.979117 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc08ca9-25f8-4bdc-8868-96cda312eed3 None None] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:56.982380 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:56.983292 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:56.983576 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:56.983856 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] PATH_INFO: `/v3/users/b4ff13c1077f4ba295c06ba4da27de9e` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:56.984281 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:56.984942 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] REQUEST_METHOD: `GET` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:56.985225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:56.985502 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:56.994501 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:56.996175 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:56.999884 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ff13c1077f4ba295c06ba4da27de9e)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:57.002629 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:57.006620 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 642/1257] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:33:56 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:33:57.058107 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ff13c1077f4ba295c06ba4da27de9e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.065021 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ff13c1077f4ba295c06ba4da27de9e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.077421 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ff13c1077f4ba295c06ba4da27de9e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.078213 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ff13c1077f4ba295c06ba4da27de9e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.086787 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ff13c1077f4ba295c06ba4da27de9e'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.093164 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 616/1258] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 10:33:56 2022] DELETE /identity/v3/users/b4ff13c1077f4ba295c06ba4da27de9e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:33:57.278058 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:57.289345 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b30c6-279b-40f1-b6a6-67cbff52265e service placement] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:57.356153 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:57.356943 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:57.357221 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:57.357505 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] PATH_INFO: `/v3/projects/c58267e480234e6a8d2f3263ba1a6aea` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:57.358801 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58267e480234e6a8d2f3263ba1a6aea)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:57.360765 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:57.386409 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:SELECT=100 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:33:57.413431 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58267e480234e6a8d2f3263ba1a6aea', 'request_id': 'req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.419981 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58267e480234e6a8d2f3263ba1a6aea', 'request_id': 'req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.426406 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58267e480234e6a8d2f3263ba1a6aea', 'request_id': 'req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.440425 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] The token cache is being invalidate because project c58267e480234e6a8d2f3263ba1a6aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 10:33:57.440715 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.441377 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.442984 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 643/1259] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 10:33:57 2022] DELETE /identity/v3/projects/c58267e480234e6a8d2f3263ba1a6aea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:33:57.447458 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:57.449029 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:57.464142 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90cf6a-197d-4b20-b557-0436be0cd0c1 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:57.468433 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:33:57.527866 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:57.528810 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:57.529088 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:57.529359 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] PATH_INFO: `/v3/users/c1fe644a05f14a94980e5f108b8f8b6c` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:57.544041 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fe644a05f14a94980e5f108b8f8b6c)` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:57.546030 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:57.601979 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fe644a05f14a94980e5f108b8f8b6c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.609626 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fe644a05f14a94980e5f108b8f8b6c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.622166 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fe644a05f14a94980e5f108b8f8b6c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.622951 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fe644a05f14a94980e5f108b8f8b6c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.631911 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.notifications [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fe644a05f14a94980e5f108b8f8b6c'} {{(pid=87019) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.638390 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 617/1260] 10.222.0.67 () {58 vars in 1223 bytes} [Wed May 25 10:33:57 2022] DELETE /identity/v3/users/c1fe644a05f14a94980e5f108b8f8b6c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:33:57.824979 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Authenticating user token {{(pid=87020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:33:57.827107 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.fernet_utils [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:33:57.843334 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a09fd8-43ae-4c16-9971-7a487cdf4b5a admin admin] Validating token access rules against request {{(pid=87020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:33:57.908078 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f728f0a5a3434bf7868adf527331fd5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '460d90891ba54a98b3b62dfbf4e206e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:33:57.908908 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:33:57.909222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] SCRIPT_NAME: `/identity` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:33:57.909475 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] PATH_INFO: `/v3/projects/b16fe08fce9844f193262c5f63d7988e` {{(pid=87020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:33:57.921238 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16fe08fce9844f193262c5f63d7988e)` {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:33:57.923138 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] RBAC: Authorization granted {{(pid=87020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:33:57.975648 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16fe08fce9844f193262c5f63d7988e', 'request_id': 'req-efcd83e9-43dd-494e-bc68-1691dbac8761'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.982996 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16fe08fce9844f193262c5f63d7988e', 'request_id': 'req-efcd83e9-43dd-494e-bc68-1691dbac8761'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:57.990440 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16fe08fce9844f193262c5f63d7988e', 'request_id': 'req-efcd83e9-43dd-494e-bc68-1691dbac8761'} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:58.006225 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] The token cache is being invalidate because project b16fe08fce9844f193262c5f63d7988e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 10:33:58.006554 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:58.007222 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG keystone.notifications [None req-efcd83e9-43dd-494e-bc68-1691dbac8761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 10:33:58.008901 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: [pid: 87020|app: 0|req: 644/1261] 10.222.0.67 () {58 vars in 1232 bytes} [Wed May 25 10:33:57 2022] DELETE /identity/v3/projects/b16fe08fce9844f193262c5f63d7988e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 10:34:07.634999 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:34:08.003133 dv-osbrick-830800-14-ceph devstack@keystone.service[87020]: DEBUG dbcounter [-] [87020] Writing DB stats keystone:DELETE=14,keystone:SELECT=70,keystone:INSERT=2 {{(pid=87020) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 10:36:56.555647 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Authenticating user token {{(pid=87019) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 10:36:56.557299 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:36:56.640490 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d8388-8e8b-4d58-96e2-5f2d81c0e824 admin admin] Validating token access rules against request {{(pid=87019) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 10:36:56.703813 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fd41b-f07f-427d-a093-96d810e7431f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4c0e33447e4a70be3de0256513ef51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '061cceafef044884ad92a96749c79856', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87019) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 10:36:56.704482 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fd41b-f07f-427d-a093-96d810e7431f service placement] REQUEST_METHOD: `GET` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 10:36:56.704771 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fd41b-f07f-427d-a093-96d810e7431f service placement] SCRIPT_NAME: `/identity` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 10:36:56.705039 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fd41b-f07f-427d-a093-96d810e7431f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87019) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 10:36:56.707110 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.fernet_utils [None req-bd4fd41b-f07f-427d-a093-96d810e7431f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87019) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 10:36:56.718527 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fd41b-f07f-427d-a093-96d810e7431f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 10:36:56.720155 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4fd41b-f07f-427d-a093-96d810e7431f service placement] RBAC: Authorization granted {{(pid=87019) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 10:36:56.730175 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: [pid: 87019|app: 0|req: 618/1262] 10.222.0.67 () {60 vars in 1365 bytes} [Wed May 25 10:36:56 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 10:37:06.725954 dv-osbrick-830800-14-ceph devstack@keystone.service[87019]: DEBUG dbcounter [-] [87019] Writing DB stats keystone:SELECT=62 {{(pid=87019) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}